high_scalability high_scalability-2009 high_scalability-2009-723 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: We saw in Why are Facebook, Digg, and Twitter so hard to scale? scaling social networks is a lot harder than you might think. This paper, Scaling Online Social Networks without Pains , from a team at Telefonica Research in Spain hopes to meet the challenge of status distribution, user generated content distribution, and managing the social graph through a technique they call One-Hop Replication (OHR). OHR abstracts and delegates the complexity of scaling up from the social network application . The abstract: Online Social Networks (OSN) face serious scalability challenges due to their rapid growth and popularity. To address this issue we present a novel approach to scale up OSN called One Hop Replication (OHR). Our system combines partitioning and replication in a middleware to transparently scale up a centralized OSN design, and therefore, avoid the OSN application to undergo the costly transition to a fully distributed system to meet its scalability needs. OHR exploits some
sentIndex sentText sentNum sentScore
1 We saw in Why are Facebook, Digg, and Twitter so hard to scale? [sent-1, score-0.061]
2 scaling social networks is a lot harder than you might think. [sent-2, score-0.428]
3 This paper, Scaling Online Social Networks without Pains , from a team at Telefonica Research in Spain hopes to meet the challenge of status distribution, user generated content distribution, and managing the social graph through a technique they call One-Hop Replication (OHR). [sent-3, score-0.573]
4 OHR abstracts and delegates the complexity of scaling up from the social network application . [sent-4, score-0.347]
5 The abstract: Online Social Networks (OSN) face serious scalability challenges due to their rapid growth and popularity. [sent-5, score-0.239]
6 To address this issue we present a novel approach to scale up OSN called One Hop Replication (OHR). [sent-6, score-0.215]
7 Our system combines partitioning and replication in a middleware to transparently scale up a centralized OSN design, and therefore, avoid the OSN application to undergo the costly transition to a fully distributed system to meet its scalability needs. [sent-7, score-0.751]
8 OHR exploits some of the structural characteristics of Social Networks: 1) most of the information is one-hop away, and 2) the topology of the network of connections among people displays a strong community structure. [sent-8, score-0.394]
9 We evaluate our system and its potential benefits and overheads using data from real OSNs: Twitter and Orkut. [sent-9, score-0.308]
10 We show that OHR has the potential to provide out-of-the-box transparent scalability while maintaining the replication overhead costs in check. [sent-10, score-0.342]
wordName wordTfidf (topN-words)
[('ohr', 0.547), ('osn', 0.547), ('social', 0.223), ('networks', 0.146), ('replication', 0.145), ('delegates', 0.124), ('undergo', 0.124), ('hop', 0.117), ('structural', 0.111), ('spain', 0.107), ('overheads', 0.104), ('pains', 0.096), ('potential', 0.095), ('meet', 0.094), ('distribution', 0.091), ('exploits', 0.088), ('displays', 0.084), ('hopes', 0.081), ('twitter', 0.077), ('online', 0.076), ('topology', 0.076), ('transparently', 0.075), ('costly', 0.075), ('middleware', 0.069), ('digg', 0.066), ('serious', 0.066), ('face', 0.064), ('characteristics', 0.064), ('combines', 0.064), ('therefore', 0.064), ('transition', 0.063), ('technique', 0.062), ('novel', 0.062), ('saw', 0.061), ('abstract', 0.061), ('centralized', 0.059), ('harder', 0.059), ('evaluate', 0.059), ('scalability', 0.058), ('generated', 0.058), ('status', 0.055), ('among', 0.055), ('scale', 0.052), ('rapid', 0.051), ('issue', 0.051), ('transparent', 0.051), ('overhead', 0.051), ('benefits', 0.05), ('partitioning', 0.05), ('present', 0.05)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 723 high scalability-2009-10-16-Paper: Scaling Online Social Networks without Pains
Introduction: We saw in Why are Facebook, Digg, and Twitter so hard to scale? scaling social networks is a lot harder than you might think. This paper, Scaling Online Social Networks without Pains , from a team at Telefonica Research in Spain hopes to meet the challenge of status distribution, user generated content distribution, and managing the social graph through a technique they call One-Hop Replication (OHR). OHR abstracts and delegates the complexity of scaling up from the social network application . The abstract: Online Social Networks (OSN) face serious scalability challenges due to their rapid growth and popularity. To address this issue we present a novel approach to scale up OSN called One Hop Replication (OHR). Our system combines partitioning and replication in a middleware to transparently scale up a centralized OSN design, and therefore, avoid the OSN application to undergo the costly transition to a fully distributed system to meet its scalability needs. OHR exploits some
2 0.15486161 804 high scalability-2010-04-06-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
3 0.15486161 814 high scalability-2010-04-20-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
4 0.10011738 721 high scalability-2009-10-13-Why are Facebook, Digg, and Twitter so hard to scale?
Introduction: Real-time social graphs (connectivity between people, places, and things). That's why scaling Facebook is hard says Jeff Rothschild , Vice President of Technology at Facebook. Social networking sites like Facebook, Digg, and Twitter are simply harder than traditional websites to scale. Why is that? Why would social networking sites be any more difficult to scale than traditional web sites? Let's find out. Traditional websites are easier to scale than social networking sites for two reasons: They usually access only their own data and common cached data. Only 1-2% of users are active on the site at one time. Imagine a huge site like Yahoo. When you come to Yahoo they can get your profile record with one get and that's enough to build your view of the website for you. It's relatively straightforward to scale systems based around single records using distributed hashing schemes . And since only a few percent of the people are on the site at once it takes comparatively little
5 0.098469608 183 high scalability-2007-12-12-Report from OpenSocial Meetup at Google
Introduction: Update: Facebook pulls a Microsoft and embraces and extends by opening their platform to other social sites like Bebo. Very smart and unexpected. More info at Facebook to let other sites access platform code . This month's regular Facebook Meetup was held at Google and the topic of the day was OpenSocial . For those of you with real lives, OpenSocial "provides a common set of APIs for social applications across multiple websites." Over 200 excited people, hoping to do very exciting things, and dreaming of making an exciting pile of money, watched an OpenSocial presentation put on by a couple of appropriately knowledgeable evangelists. I could feel my social graph being more successfully monetized with each passing minute. Normally the meetings are much smaller, but Google puts on a very nice spread, so I think people may have showed up to dine :-) Or they could have showed up to learn why and how they should code to the new uber social API. By the looks of the full pl
6 0.095935665 811 high scalability-2010-04-16-Hot Scalability Links for April 16, 2010
7 0.079603717 1087 high scalability-2011-07-26-Web 2.0 Killed the Middleware Star
8 0.077933542 621 high scalability-2009-06-06-Graph server
9 0.076738797 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
10 0.07565698 1094 high scalability-2011-08-08-Tagged Architecture - Scaling to 100 Million Users, 1000 Servers, and 5 Billion Page Views
11 0.073989101 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
12 0.06953676 720 high scalability-2009-10-12-High Performance at Massive Scale – Lessons learned at Facebook
14 0.066887468 758 high scalability-2010-01-11-Have We Reached the End of Scaling?
15 0.066530846 628 high scalability-2009-06-13-Neo4j - a Graph Database that Kicks Buttox
16 0.065477178 802 high scalability-2010-04-01-Hot Scalability Links for April 1, 2010
17 0.064915448 1251 high scalability-2012-05-24-Build your own twitter like real time analytics - a step by step guide
18 0.062680103 722 high scalability-2009-10-15-Hot Scalability Links for Oct 15 2009
19 0.062612735 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
20 0.062391929 1490 high scalability-2013-07-12-Stuff The Internet Says On Scalability For July 12, 2013
topicId topicWeight
[(0, 0.097), (1, 0.021), (2, 0.042), (3, 0.006), (4, 0.054), (5, -0.001), (6, -0.065), (7, -0.005), (8, -0.023), (9, 0.051), (10, 0.063), (11, 0.052), (12, -0.016), (13, -0.015), (14, -0.042), (15, 0.048), (16, 0.019), (17, 0.033), (18, 0.035), (19, 0.066), (20, -0.028), (21, 0.052), (22, 0.017), (23, 0.03), (24, -0.021), (25, 0.027), (26, -0.034), (27, -0.061), (28, -0.016), (29, -0.049), (30, 0.101), (31, -0.066), (32, 0.007), (33, 0.035), (34, -0.001), (35, -0.062), (36, 0.005), (37, 0.007), (38, 0.02), (39, 0.035), (40, 0.043), (41, -0.044), (42, -0.035), (43, 0.014), (44, -0.036), (45, 0.008), (46, -0.039), (47, 0.02), (48, 0.023), (49, -0.016)]
simIndex simValue blogId blogTitle
same-blog 1 0.97920805 723 high scalability-2009-10-16-Paper: Scaling Online Social Networks without Pains
Introduction: We saw in Why are Facebook, Digg, and Twitter so hard to scale? scaling social networks is a lot harder than you might think. This paper, Scaling Online Social Networks without Pains , from a team at Telefonica Research in Spain hopes to meet the challenge of status distribution, user generated content distribution, and managing the social graph through a technique they call One-Hop Replication (OHR). OHR abstracts and delegates the complexity of scaling up from the social network application . The abstract: Online Social Networks (OSN) face serious scalability challenges due to their rapid growth and popularity. To address this issue we present a novel approach to scale up OSN called One Hop Replication (OHR). Our system combines partitioning and replication in a middleware to transparently scale up a centralized OSN design, and therefore, avoid the OSN application to undergo the costly transition to a fully distributed system to meet its scalability needs. OHR exploits some
2 0.82091868 804 high scalability-2010-04-06-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
3 0.82091868 814 high scalability-2010-04-20-Sponsored Post: Event - Social Developer Summit
Introduction: Social Developer Summit - June 29, 2010 - San Franciso, CA A meeting of the technically social - Building, scaling, and profiting in a social age Whether it's social games, social news, social discovery, social search, or other forms of social solutions , developers today are facing new hurdles in building instantly scalable products. As new technologies emerge to address the challenges faced by social application developers, it's increasingly important to come together for knowledge sharing purposes. The first Social Developer Summit will bring together social application developers to discuss the challenges, solutions, and best practices for building applications in the rapidly expanding social web economy . At the Social Developer Summit, industry experts will share tips and case studies for building high performance social web products. For more information please take a look at Social Developer Summit . If you are interested in a sponsored pos
4 0.71119517 811 high scalability-2010-04-16-Hot Scalability Links for April 16, 2010
Introduction: Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+. Cloud Computing Economies of Scale . James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here . Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more. Extreme Scale Computing by Irving Wladawsky-Berger . “An exascale supercomputer capable of a million tr
5 0.66679817 183 high scalability-2007-12-12-Report from OpenSocial Meetup at Google
Introduction: Update: Facebook pulls a Microsoft and embraces and extends by opening their platform to other social sites like Bebo. Very smart and unexpected. More info at Facebook to let other sites access platform code . This month's regular Facebook Meetup was held at Google and the topic of the day was OpenSocial . For those of you with real lives, OpenSocial "provides a common set of APIs for social applications across multiple websites." Over 200 excited people, hoping to do very exciting things, and dreaming of making an exciting pile of money, watched an OpenSocial presentation put on by a couple of appropriately knowledgeable evangelists. I could feel my social graph being more successfully monetized with each passing minute. Normally the meetings are much smaller, but Google puts on a very nice spread, so I think people may have showed up to dine :-) Or they could have showed up to learn why and how they should code to the new uber social API. By the looks of the full pl
6 0.62372369 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
7 0.6230619 722 high scalability-2009-10-15-Hot Scalability Links for Oct 15 2009
8 0.61285615 802 high scalability-2010-04-01-Hot Scalability Links for April 1, 2010
10 0.58898371 755 high scalability-2009-12-28-Zynga Needs a Server-side Systems Engineer
11 0.56074917 846 high scalability-2010-06-22-Sponsored Post: Jobs: Etsy, Digg, Huffington Post Event: Velocity Conference
12 0.55928105 677 high scalability-2009-08-09-NoSQL: If Only It Was That Easy
13 0.50680387 1094 high scalability-2011-08-08-Tagged Architecture - Scaling to 100 Million Users, 1000 Servers, and 5 Billion Page Views
14 0.5058521 721 high scalability-2009-10-13-Why are Facebook, Digg, and Twitter so hard to scale?
15 0.4930366 976 high scalability-2011-01-20-75% Chance of Scale - Leveraging the New Scaleogenic Environment for Growth
16 0.48897493 1087 high scalability-2011-07-26-Web 2.0 Killed the Middleware Star
17 0.47377262 1435 high scalability-2013-04-04-Paper: A Web of Things Application Architecture - Integrating the Real-World into the Web
18 0.47272691 1251 high scalability-2012-05-24-Build your own twitter like real time analytics - a step by step guide
20 0.4608044 1495 high scalability-2013-07-22-We're on a Break
topicId topicWeight
[(1, 0.126), (2, 0.654), (10, 0.01), (61, 0.053), (94, 0.027)]
simIndex simValue blogId blogTitle
1 0.99623489 205 high scalability-2008-01-10-Letting Clients Know What's Changed: Push Me or Pull Me?
Introduction: I had a false belief I thought I came here to stay We're all just visiting All just breaking like waves The oceans made me, but who came up with me? Push me, pull me, push me, or pull me out . So true Perl Jam (Push me Pull me lyrics) , so true. I too have wondered how web clients should be notified of model changes. Should servers push events to clients or should clients pull events from servers? A topic worthy of its own song if ever there was one. To pull events the client simply starts a timer and makes a request to the server. This is polling. You can either pull a complete set of fresh data or get a list of changes. The server "knows" if anything you are interested in has changed and makes those changes available to you. Knowing what has changed can be relatively simple with a publish-subscribe type backend or you can get very complex with fine grained bit maps of attributes and keeping per client state on what I client still needs to see. Polling is heavy man.
same-blog 2 0.99593294 723 high scalability-2009-10-16-Paper: Scaling Online Social Networks without Pains
Introduction: We saw in Why are Facebook, Digg, and Twitter so hard to scale? scaling social networks is a lot harder than you might think. This paper, Scaling Online Social Networks without Pains , from a team at Telefonica Research in Spain hopes to meet the challenge of status distribution, user generated content distribution, and managing the social graph through a technique they call One-Hop Replication (OHR). OHR abstracts and delegates the complexity of scaling up from the social network application . The abstract: Online Social Networks (OSN) face serious scalability challenges due to their rapid growth and popularity. To address this issue we present a novel approach to scale up OSN called One Hop Replication (OHR). Our system combines partitioning and replication in a middleware to transparently scale up a centralized OSN design, and therefore, avoid the OSN application to undergo the costly transition to a fully distributed system to meet its scalability needs. OHR exploits some
3 0.99550205 455 high scalability-2008-12-01-MySQL Database Scale-out and Replication for High Growth Businesses
Introduction: It is widely recognized that MySQL is the most popular database software in the world. Since its inception in 1995, there have been 11 million product installations around the world in a wide variety of markets. There are more installations of MySQL in use today than any other database architecture. From startup companies hoping to be the next Web2.0 poster child to large global enterprises, the MySQL database architecture has proven to be flexible, extendable, scalable, and more than capable of filling high-capacity database roles in very different venues.
4 0.99522573 594 high scalability-2009-05-08-Eight Best Practices for Building Scalable Systems
Introduction: Wille Faler has created an excellent list of best practices for building scalable and high performance systems. Here's a short summary of his points: Offload the database - Avoid hitting the database, and avoid opening transactions or connections unless you absolutely need to use them. What a difference a cache makes - For read heavy applications caching is the easiest way offload the database. Cache as coarse-grained objects as possible - Coarse-grained objects save CPU and time by requiring fewer reads to assemble objects. Don’t store transient state permanently - Is it really necessary to store your transient data in the database? Location, Location - put things close to where they are supposed to be delivered. Constrain concurrent access to limited resource - it's quicker to let a single thread do work and finish rather than flooding finite resources with 200 client threads. Staged, asynchronous processing - separate a process using asynchronicity int
5 0.99281031 878 high scalability-2010-08-12-Strategy: Terminate SSL Connections in Hardware and Reduce Server Count by 40%
Introduction: This is an interesting tidbit from near the end of the Packet Pushers podcast Show 15 – Saving the Web With Dinky Putt Putt Firewalls . The conversation was about how SSL connections need to terminate before they can be processed by a WAF ( Web Application Firewall ), which inspects HTTP for security problems like SQL injection and cross-site scripting exploits. Much was made that if programmers did their job better these appliances wouldn't be necessary, but I digress. To terminate SSL most shops run SSL connections into Intel based Linux boxes running Apache. This setup is convenient for developers, but it's not optimized for SSL, so it's slow and costly. Much of the capacity of these servers are unnecessarily consumed processing SSL. Load balancers on the other hand have crypto cards that terminate SSL very efficiently in hardware. Efficiently enough that if you are willing to get rid of the general purpose Linux boxes and use your big iron load balancers, your server count c
6 0.99256867 911 high scalability-2010-09-30-More Troubles with Caching
8 0.99161279 967 high scalability-2011-01-03-Stuff The Internet Says On Scalability For January 3, 2010
9 0.99139977 836 high scalability-2010-06-04-Strategy: Cache Larger Chunks - Cache Hit Rate is a Bad Indicator
10 0.98764491 1199 high scalability-2012-02-27-Zen and the Art of Scaling - A Koan and Epigram Approach
11 0.98679858 1190 high scalability-2012-02-10-Stuff The Internet Says On Scalability For February 10, 2012
12 0.98666322 551 high scalability-2009-03-30-Lavabit Architecture - Creating a Scalable Email Service
13 0.98588711 223 high scalability-2008-01-25-Google: Introduction to Distributed System Design
14 0.98359662 436 high scalability-2008-11-02-Strategy: How to Manage Sessions Using Memcached
15 0.98313636 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
16 0.98209518 1591 high scalability-2014-02-05-Little’s Law, Scalability and Fault Tolerance: The OS is your bottleneck. What you can do?
17 0.97930998 1006 high scalability-2011-03-17-Are long VM instance spin-up times in the cloud costing you money?
18 0.97844112 1283 high scalability-2012-07-13-Stuff The Internet Says On Scalability For July 13, 2012
19 0.97808814 56 high scalability-2007-08-03-Running Hadoop MapReduce on Amazon EC2 and Amazon S3
20 0.97808814 565 high scalability-2009-04-13-Benchmark for keeping data in browser in AJAX projects