high_scalability high_scalability-2009 high_scalability-2009-595 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: on Wiki someone posted "...For relatively small installations, pub/sub provides the opportunity for better scalability than traditional client-server, through parallel operation, message caching, tree-based or network-based routing, etc. However, as systems scale up to become datacenters with thousands of servers sharing the pub/sub infrastructure, this benefit is often lost; in fact, scalability for pub/sub products under high load in large deployments is very much a research challenge. " Does anyone have something to say regarding scaling Publish/subscribe models?
sentIndex sentText sentNum sentScore
1 For relatively small installations, pub/sub provides the opportunity for better scalability than traditional client-server, through parallel operation, message caching, tree-based or network-based routing, etc. [sent-4, score-1.196]
2 However, as systems scale up to become datacenters with thousands of servers sharing the pub/sub infrastructure, this benefit is often lost; in fact, scalability for pub/sub products under high load in large deployments is very much a research challenge. [sent-5, score-2.023]
3 " Does anyone have something to say regarding scaling Publish/subscribe models? [sent-6, score-0.714]
wordName wordTfidf (topN-words)
[('installations', 0.301), ('wiki', 0.286), ('regarding', 0.28), ('posted', 0.267), ('deployments', 0.232), ('lost', 0.206), ('benefit', 0.191), ('datacenters', 0.185), ('opportunity', 0.185), ('sharing', 0.175), ('models', 0.172), ('research', 0.169), ('routing', 0.169), ('message', 0.165), ('operation', 0.162), ('relatively', 0.158), ('anyone', 0.156), ('fact', 0.152), ('traditional', 0.15), ('someone', 0.138), ('scalability', 0.136), ('thousands', 0.135), ('parallel', 0.123), ('products', 0.123), ('become', 0.119), ('say', 0.113), ('provides', 0.108), ('often', 0.108), ('caching', 0.101), ('small', 0.094), ('infrastructure', 0.089), ('something', 0.085), ('scaling', 0.08), ('better', 0.077), ('load', 0.071), ('large', 0.067), ('much', 0.066), ('servers', 0.062), ('systems', 0.062), ('scale', 0.061), ('high', 0.061)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 595 high scalability-2009-05-08-Publish-subscribe model does not scale?
Introduction: on Wiki someone posted "...For relatively small installations, pub/sub provides the opportunity for better scalability than traditional client-server, through parallel operation, message caching, tree-based or network-based routing, etc. However, as systems scale up to become datacenters with thousands of servers sharing the pub/sub infrastructure, this benefit is often lost; in fact, scalability for pub/sub products under high load in large deployments is very much a research challenge. " Does anyone have something to say regarding scaling Publish/subscribe models?
2 0.14361414 140 high scalability-2007-11-02-How WordPress.com Tracks 300 Servers Handling 10 Million Pageviews
Introduction: WordPress.com hosts 300 servers in 5 different data centers. It's always useful to learn how large installations manage all their unruly children: Currently we Nagios for server health monitoring, Munin for graphing various server metrics, and a wiki to keep track of all the server hardware specs, IPs, vendor IDs, etc. All of these tools have suited us well up until now, but there have been some scaling issues. The post covers how these different tools are working for them and the comment section has some interesting discussions too.
3 0.13762465 455 high scalability-2008-12-01-MySQL Database Scale-out and Replication for High Growth Businesses
Introduction: It is widely recognized that MySQL is the most popular database software in the world. Since its inception in 1995, there have been 11 million product installations around the world in a wide variety of markets. There are more installations of MySQL in use today than any other database architecture. From startup companies hoping to be the next Web2.0 poster child to large global enterprises, the MySQL database architecture has proven to be flexible, extendable, scalable, and more than capable of filling high-capacity database roles in very different venues.
4 0.10446273 179 high scalability-2007-12-10-Future of EJB3 !! ??
Introduction: What i s the future of EJB3 i n the i ndustry , g i ven the current trends ? There are a l ot of arguments regard i ng EJB3 be i ng heavy we i ghted ..... A l so, what cou l d be the a l ternat i ves of EJB3 ? How about the sca l abi l ity, pers i stence, performance and other factors ?
5 0.09678027 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
Introduction: This is a guest post by Frédéric Faure (architect at Ysance ) on the differences between using a cloud infrastructure and building your own. Frédéric was kind enough to translate the original French version of this article into English. I’ve been noticing many questions about the differences inherent in choosing between a Cloud infrastructure such as AWS (Amazon Web Services) and a traditional physical infrastructure. Firstly, there are a certain number of preconceived notions on this subject that I will attempt to decode for you. Then, it must be understood that each infrastructure has its advantages and disadvantages: a Cloud-type infrastructure does not necessarily fulfill your requirements in every case, however, it can satisfy some of them by optimizing or facilitating the features offered by a traditional physical infrastructure. I will therefore demonstrate the differences between the two that I have noticed, in order to help you make up your own mind. The Fram
6 0.095278174 591 high scalability-2009-05-06-Dyrad
7 0.088899538 584 high scalability-2009-04-27-Some Questions from a newbie
8 0.087907173 1492 high scalability-2013-07-17-How do you create a 100th Monkey software development culture?
9 0.086317621 111 high scalability-2007-10-04-Number of load balanced servers
10 0.086082205 856 high scalability-2010-07-12-Creating Scalable Digital Libraries
11 0.085487008 863 high scalability-2010-07-22-How can we spark the movement of research out of the Ivory Tower and into production?
12 0.084507853 687 high scalability-2009-08-24-How Google Serves Data from Multiple Datacenters
13 0.083335809 577 high scalability-2009-04-22-Gear6 Web cache - the hardware solution for working with Memcache
14 0.083157189 90 high scalability-2007-09-12-Technology behind mediatemple grid service
15 0.081429653 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
17 0.079180717 70 high scalability-2007-08-22-How many machines do you need to run your site?
18 0.076560266 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
19 0.076120503 72 high scalability-2007-08-22-Wikimedia architecture
20 0.076114006 1344 high scalability-2012-10-19-Stuff The Internet Says On Scalability For October 19, 2012
topicId topicWeight
[(0, 0.126), (1, 0.039), (2, 0.02), (3, 0.011), (4, 0.002), (5, -0.008), (6, -0.01), (7, -0.02), (8, -0.064), (9, 0.033), (10, -0.026), (11, 0.003), (12, -0.013), (13, -0.004), (14, -0.003), (15, -0.037), (16, 0.028), (17, 0.016), (18, -0.044), (19, 0.042), (20, 0.009), (21, 0.055), (22, -0.047), (23, -0.06), (24, 0.006), (25, -0.007), (26, 0.017), (27, -0.01), (28, 0.001), (29, 0.02), (30, 0.02), (31, 0.001), (32, -0.023), (33, -0.001), (34, -0.0), (35, -0.023), (36, 0.019), (37, -0.074), (38, 0.063), (39, -0.028), (40, 0.045), (41, 0.001), (42, -0.025), (43, -0.061), (44, 0.009), (45, -0.009), (46, 0.003), (47, -0.009), (48, 0.055), (49, -0.034)]
simIndex simValue blogId blogTitle
same-blog 1 0.96263021 595 high scalability-2009-05-08-Publish-subscribe model does not scale?
Introduction: on Wiki someone posted "...For relatively small installations, pub/sub provides the opportunity for better scalability than traditional client-server, through parallel operation, message caching, tree-based or network-based routing, etc. However, as systems scale up to become datacenters with thousands of servers sharing the pub/sub infrastructure, this benefit is often lost; in fact, scalability for pub/sub products under high load in large deployments is very much a research challenge. " Does anyone have something to say regarding scaling Publish/subscribe models?
2 0.67113197 1127 high scalability-2011-09-28-Pursue robust indefinite scalability with the Movable Feast Machine
Introduction: And now for something completely different, brought to you by David Ackley and Daniel Cannon in their playfully thought provoking paper: Pursue robust indefinite scalability , wherein they try to take a fresh look at neural networks, starting from scratch. What is this strange thing called indefinite scalability ? They sound like words that don't really go together: Indefinite scalability is the property that the design can support open-ended computational growth without substantial re-engineering, in as strict as sense as can be managed. By comparison, many computer, algorithm, and network designs -- even those that address scalability -- are only finitely scalable because their scalability occurs within some finite space. For example, an in-core sorting algorithm for a 32 bit machine can only scale to billions of numbers before address space is exhausted and then that algorithm must be re-engineered. Our idea is to expose indefinitely scalable computational power to program
3 0.67012304 690 high scalability-2009-08-31-Scaling MySQL on Amazon Web Services
Introduction: I've recently started working with a large company who is looking to take one of their heavily utilized applications and move it to Amazon Web Services. I'm not looking to start a debate on the merits of EC2, the decision to move to aws is already made (and is a much better decision than paying a vendor millions to host it). I've done my reasearch and I'm comfortable with creating this environment with one exception, scaling MySQL. I havent done much work with MySQL, i'm more of an Oracle guy up to now. I'm struggling to determine a way to scale MySQL on the fly in a way so that replication works, the server takes its proper place in line for master candidacy, and the apache servers become aware of it. So this is really three questions: 1. What are some proven methods of load balancing the read traffic going from apache to MySQL. 2. How do I let the load balancing mechanism know when I scale up / down a new Mysql Server? 3. How to alert the master of the new server and initiate
4 0.66553211 869 high scalability-2010-07-30-Hot Scalability Links for July 30, 2010
Introduction: Jeremy Zawodny, while performing data alchemy in the dungeons of Craigslist, stored 1,250,000,000 Key/Value Pairs in Redis on a 32GB Machine . Data sorting world record: 1 terabyte, 1 minute . The system has 52 computer nodes, each node is a commodity server with two quad-core processors, 24 gigabytes (GB) memory and sixteen 500 GB disks . It's not just hardware though, they also built a software that utilized all their CPU and RAM. Tweets of Gold: wm : I am really getting the sense that none of you yokels waxing profound about scalability actually has anything factual to say joestump : I think you can do things to *mitigate* pain points up front. You don't need to over-engineer, but it's not hard to look forward. danielcrenna : I love it when I check in debug code accidentally and it turns into a three day hunt for a major scalability problem joestump : Your post also makes me think of another phrase I say often: Scaling == Specialization. Bigger scale =
5 0.6536926 185 high scalability-2007-12-13-Is premature scalation a real disease?
Introduction: Update 3: InfoQ's Big Architecture Up Front - A Case of Premature Scalaculation? twines several different threads on the topic together into a fine noose. Update 2: Kevin says the biggest problems he sees with startups is they need to scale their backend (no, the other one). Update: My bad. It's hard to sell scalability so just forget it. The premise of Startups and The Problem Of Premature Scalaculation and Don’t scale: 99.999% uptime is for Wal-Mart is that you shouldn't spend precious limited resources worrying about scaling before you've first implemented the functionality that will make you successful enough to have scaling problems in the first place. It's kind of an embodied life force model of system creation. Energy is scarce so any parasites siphoning off energy must be hunted down and destroyed so the body has its best chance of survival. Is this really how it works? If I ever believed this I certainly don't believe it anymore. The world has c
6 0.63509995 426 high scalability-2008-10-22-Server load balancing architectures, Part 1: Transport-level load balancing
7 0.63204288 142 high scalability-2007-11-05-Strategy: Diagonal Scaling - Don't Forget to Scale Out AND Up
8 0.63088411 591 high scalability-2009-05-06-Dyrad
9 0.62847996 111 high scalability-2007-10-04-Number of load balanced servers
10 0.62768394 620 high scalability-2009-06-05-SSL RPC API Scalability
11 0.60887069 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
13 0.60407585 381 high scalability-2008-09-08-Guerrilla Capacity Planning and the Law of Universal Scalability
14 0.60287863 1075 high scalability-2011-07-07-Myth: Google Uses Server Farms So You Should Too - Resurrection of the Big-Ass Machines
15 0.60103154 906 high scalability-2010-09-22-Applying Scalability Patterns to Infrastructure Architecture
16 0.5999428 140 high scalability-2007-11-02-How WordPress.com Tracks 300 Servers Handling 10 Million Pageviews
17 0.59713966 1325 high scalability-2012-09-19-The 4 Building Blocks of Architecting Systems for Scale
18 0.59436524 1206 high scalability-2012-03-09-Stuff The Internet Says On Scalability For March 9, 2012
19 0.5940944 157 high scalability-2007-11-16-Product: lbpool - Load Balancing JDBC Pool
20 0.59375912 1344 high scalability-2012-10-19-Stuff The Internet Says On Scalability For October 19, 2012
topicId topicWeight
[(1, 0.072), (2, 0.408), (5, 0.082), (61, 0.134), (79, 0.165)]
simIndex simValue blogId blogTitle
same-blog 1 0.98863822 595 high scalability-2009-05-08-Publish-subscribe model does not scale?
Introduction: on Wiki someone posted "...For relatively small installations, pub/sub provides the opportunity for better scalability than traditional client-server, through parallel operation, message caching, tree-based or network-based routing, etc. However, as systems scale up to become datacenters with thousands of servers sharing the pub/sub infrastructure, this benefit is often lost; in fact, scalability for pub/sub products under high load in large deployments is very much a research challenge. " Does anyone have something to say regarding scaling Publish/subscribe models?
2 0.97652048 230 high scalability-2008-01-29-Speed up (Oracle) database code with result caching
Introduction: One of the most interesting new features of Oracle 11 is the new function result caching mechanism. Until now, making sure that a PL/SQL function gets executed only as many times as necessary was a black art. The new caching system makes that quite easy -- here is how it works.
3 0.97137105 252 high scalability-2008-02-18-limit on the number of databases open
Introduction: Have a few doubts.. here are the qs 1) is there any limit on the number of databases that can be accessed simultaneously? (MySQL) 2) will it be a problem to scale in the future if there are large number of small databases(2-5 MB) each?
4 0.97084308 1017 high scalability-2011-04-06-Netflix: Run Consistency Checkers All the time to Fixup Transactions
Introduction: You might have consistency problems if you have: multiple datastores in multiple datacenters, without distributed transactions, and with the ability to alternately execute out of each datacenter; syncing protocols that can fail or sync stale data; distributed clients that cache data and then write old back to the central store; a NoSQL database that doesn't have transactions between updates of multiple related key-value records; application level integrity checks; client driven optimistic locking . Sounds a lot like many evolving, loosely coupled, autonomous, distributed systems these days. How do you solve these consistency problems? Siddharth "Sid" Anand of Netflix talks about how they solved theirs in his excellent presentation, NoSQL @ Netflix : Part 1 , given to a packed crowd at a Cloud Computing Meetup . You might be inclined to say how silly it is to have these problems in the first place, but just hold on. See if you might share some of their problems, before gettin
5 0.96445215 717 high scalability-2009-10-07-How to Avoid the Top 5 Scale-Out Pitfalls
Introduction: Scale-Out is incrementally adding servers as needed to scale rather than buying larger servers. Here's the MySQL idea of what a scale-out architecture looks like: This MySQL article lists 5 problems to avoid when scaling out: Don't Think Synchronously . Introduce asynchronous communication, parallelization, and strategies to deal with approximate or slightly outdated data. Don't Think Vertically. Scaling by bigger machines won't work. Plan on horizontal scaling and asynchronous architectures form the start which make it easy to add capacity on demand. Don't Mix Transactions with Business Intelligence. Transactions and analytics are inherently different. Separate out different types of data onto different databases. Avoid Mixing Hot and Cold Data. Static and fast changing data are inherently different. Separate out different types of data onto different databases. Don't Forget the Power of Memory. Make data accessible in RA
6 0.96407169 620 high scalability-2009-06-05-SSL RPC API Scalability
9 0.96030462 658 high scalability-2009-07-17-Against all the odds
10 0.95837188 684 high scalability-2009-08-18-Real World Web: Performance & Scalability
11 0.95810509 628 high scalability-2009-06-13-Neo4j - a Graph Database that Kicks Buttox
12 0.95676762 236 high scalability-2008-02-03-Ideas on how to scale a shared inventory database???
13 0.95659018 359 high scalability-2008-07-29-Ehcache - A Java Distributed Cache
14 0.95630157 124 high scalability-2007-10-16-How Scalable are Single Page Ajax Apps?
15 0.95566654 533 high scalability-2009-03-11-The Implications of Punctuated Scalabilium for Website Architecture
16 0.95525694 844 high scalability-2010-06-18-Paper: The Declarative Imperative: Experiences and Conjectures in Distributed Logic
17 0.95391506 169 high scalability-2007-12-01-many website, one setup, many databases
18 0.95364523 1413 high scalability-2013-02-27-42 Monster Problems that Attack as Loads Increase
19 0.95329815 1523 high scalability-2013-09-27-Stuff The Internet Says On Scalability For September 27, 2013
20 0.95319611 189 high scalability-2007-12-21-Strategy: Limit Result Sets