high_scalability high_scalability-2009 high_scalability-2009-664 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Virtualization offers a lot of benefits, but it also comes with a cost (memory, CPU, network, IO, licensing). If you are in or running a cloud then some form of virtualization may not even be an option. But if you are running your own string of servers you can choose to go without. Free will and all that. Should you or shouldn't you? In a detailed comparison the folks at 37signals found that running their Rails application servers without virtualization resulted in A 66% reduction in the response time while handling multiples of the traffic is beyond what I expected . As is common 37signals runs their big database servers without virtualization. They use a scale-up approach at the database tier so extracting every bit of performance out of those servers is key. Application servers typically use a scale-out approach for scalability, which is virtualization friendly, but that says nothing about performance. Finding performance increases, especially when you are running on a d
sentIndex sentText sentNum sentScore
1 Virtualization offers a lot of benefits, but it also comes with a cost (memory, CPU, network, IO, licensing). [sent-1, score-0.184]
2 If you are in or running a cloud then some form of virtualization may not even be an option. [sent-2, score-0.567]
3 But if you are running your own string of servers you can choose to go without. [sent-3, score-0.631]
4 In a detailed comparison the folks at 37signals found that running their Rails application servers without virtualization resulted in A 66% reduction in the response time while handling multiples of the traffic is beyond what I expected . [sent-6, score-2.062]
5 As is common 37signals runs their big database servers without virtualization. [sent-7, score-0.519]
6 They use a scale-up approach at the database tier so extracting every bit of performance out of those servers is key. [sent-8, score-0.895]
7 Application servers typically use a scale-out approach for scalability, which is virtualization friendly, but that says nothing about performance. [sent-9, score-0.946]
8 Finding performance increases, especially when you are running on a dynamic language is a challenge. [sent-10, score-0.475]
9 Something to consider when you are casting around wondering how you can get more bang for your buck. [sent-12, score-0.74]
wordName wordTfidf (topN-words)
[('virtualization', 0.315), ('multiples', 0.261), ('casting', 0.261), ('ina', 0.24), ('buck', 0.232), ('extracting', 0.22), ('servers', 0.198), ('licensing', 0.197), ('bang', 0.187), ('string', 0.163), ('running', 0.157), ('reduction', 0.154), ('friendly', 0.15), ('folks', 0.142), ('wondering', 0.14), ('comparison', 0.133), ('approach', 0.131), ('rails', 0.131), ('improvements', 0.129), ('tier', 0.122), ('typically', 0.119), ('beyond', 0.113), ('choose', 0.113), ('benefits', 0.112), ('detailed', 0.111), ('increases', 0.11), ('io', 0.106), ('offers', 0.101), ('form', 0.095), ('says', 0.093), ('handling', 0.092), ('bit', 0.092), ('consider', 0.092), ('without', 0.091), ('nothing', 0.09), ('runs', 0.09), ('language', 0.088), ('especially', 0.086), ('comes', 0.083), ('dynamic', 0.08), ('response', 0.077), ('application', 0.076), ('found', 0.074), ('common', 0.072), ('traffic', 0.068), ('database', 0.068), ('free', 0.067), ('cpu', 0.064), ('performance', 0.064), ('around', 0.06)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 664 high scalability-2009-07-29-Strategy: Devirtualize for More Vroom
Introduction: Virtualization offers a lot of benefits, but it also comes with a cost (memory, CPU, network, IO, licensing). If you are in or running a cloud then some form of virtualization may not even be an option. But if you are running your own string of servers you can choose to go without. Free will and all that. Should you or shouldn't you? In a detailed comparison the folks at 37signals found that running their Rails application servers without virtualization resulted in A 66% reduction in the response time while handling multiples of the traffic is beyond what I expected . As is common 37signals runs their big database servers without virtualization. They use a scale-up approach at the database tier so extracting every bit of performance out of those servers is key. Application servers typically use a scale-out approach for scalability, which is virtualization friendly, but that says nothing about performance. Finding performance increases, especially when you are running on a d
2 0.23437372 924 high scalability-2010-10-21-What is Network-based Application Virtualization and Why Do You Need It?
Introduction: With all the attention being paid these days to VDI (virtual desktop infrastructure) and application virtualization and server virtualization andvirtualization it’s easy to forget about network-based application virtualization. But it’s the one virtualization technique you shouldn’t forget because it is a foundational technology upon which myriad other solutions will be enabled. WHAT IS NETWORK-BASED APPLICATION VIRTUALIZATION? This term may not be familiar to you but that’s because since its inception oh, more than a decade ago, it’s always just been called “server virtualization”. After the turn of the century (I love saying that, by the way) it was always referred to as service virtualization in SOA and XML circles. With the rise of the likes of VMware and Citrix and Microsoft server virtualization solutions, it’s become impossible to just use the term “server virtualization” and “service virtualization” is just as ambiguous so it seems appropriate to giv
Introduction: One stumbling block of the the great march towards virtualization is the relatively poor performance of resource hungry applications like databases. We are told to develop and test using VMs, but deploy without them. Which kind of sucks IMHO. Maybe better virtualization technology can remove this split. This paper talks about a different approach to virtualization called "container-based" virtualization that can reportedly double the performance of traditional hypervisor systems like Xen. It does this by trading isolation for efficiency. Rather than maintaining complete isolation between VMs the container approach shares resources between VMs and thus gives higher performance while still guaranteeing strong fault, resource, and security isolation. It's yet another battle in computing's endless war of creating and destroying abstraction layers. I learned a lot from from this paper because of how it compared and contrasted traditional hypervisor and container based virtualization strateg
4 0.11917165 479 high scalability-2008-12-29-Platform virtualization - top 25 providers (software, hardware, combined)
Introduction: In this article they present the companies which offers means (mainly, the software and hardware) which powers most of the cloud computing hosting providers, namely virtualization solutions. Read the entire article about Platform virtualization - top 25 providers (software, hardware, combined) at MyTestBox.com - web software reviews, news, tips & tricks .
5 0.11824632 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
Introduction: Update: Jake in Does Django really scale better than Rails? thinks apps like FFS shouldn't need so much hardware to scale. In a short three months Friends for Sale (think Hot-or-Not with a market economy) grew to become a top 10 Facebook application handling 200 gorgeous requests per second and a stunning 300 million page views a month. They did all this using Ruby on Rails, two part time developers, a cluster of a dozen machines, and a fairly standard architecture. How did Friends for Sale scale to sell all those beautiful people? And how much do you think your friends are worth on the open market? Site: http://www.facebook.com/apps/application.php?id=7019261521 Information Sources Siqi Chen and Alexander Le, co-creators of Friends for Sale, answering my standard questionairre. Virality on Facebook The Platform Ruby on Rails CentOS 5 (64 bit) Capistrano - update and restart application servers. Memcached MySQL Nginx Starling - distrib
6 0.11712596 663 high scalability-2009-07-28-37signals Architecture
7 0.11146656 70 high scalability-2007-08-22-How many machines do you need to run your site?
8 0.10940176 1423 high scalability-2013-03-13-Iron.io Moved From Ruby to Go: 28 Servers Cut and Colossal Clusterf**ks Prevented
13 0.10475007 1521 high scalability-2013-09-23-Salesforce Architecture - How they Handle 1.3 Billion Transactions a Day
14 0.10142494 762 high scalability-2010-01-18-The Missing Piece in the Virtualization Stack (Part 1)
15 0.098866336 176 high scalability-2007-12-07-Synchronizing databases in different geographic locations
18 0.09475296 1157 high scalability-2011-12-14-Virtualization and Cloud Computing is Changing the Network to East-West Routing
19 0.094142616 1404 high scalability-2013-02-11-At Scale Even Little Wins Pay Off Big - Google and Facebook Examples
topicId topicWeight
[(0, 0.159), (1, 0.029), (2, -0.009), (3, -0.04), (4, -0.064), (5, -0.015), (6, 0.06), (7, -0.024), (8, -0.003), (9, 0.017), (10, -0.008), (11, 0.022), (12, -0.038), (13, 0.063), (14, -0.069), (15, -0.041), (16, 0.067), (17, 0.028), (18, -0.029), (19, 0.001), (20, -0.01), (21, -0.011), (22, -0.026), (23, -0.017), (24, 0.076), (25, 0.051), (26, -0.017), (27, -0.056), (28, -0.007), (29, 0.032), (30, 0.008), (31, -0.013), (32, 0.006), (33, 0.044), (34, -0.033), (35, 0.015), (36, -0.008), (37, 0.003), (38, -0.042), (39, 0.044), (40, 0.022), (41, -0.091), (42, -0.023), (43, 0.014), (44, -0.047), (45, -0.071), (46, 0.024), (47, -0.01), (48, 0.038), (49, -0.02)]
simIndex simValue blogId blogTitle
same-blog 1 0.96408743 664 high scalability-2009-07-29-Strategy: Devirtualize for More Vroom
Introduction: Virtualization offers a lot of benefits, but it also comes with a cost (memory, CPU, network, IO, licensing). If you are in or running a cloud then some form of virtualization may not even be an option. But if you are running your own string of servers you can choose to go without. Free will and all that. Should you or shouldn't you? In a detailed comparison the folks at 37signals found that running their Rails application servers without virtualization resulted in A 66% reduction in the response time while handling multiples of the traffic is beyond what I expected . As is common 37signals runs their big database servers without virtualization. They use a scale-up approach at the database tier so extracting every bit of performance out of those servers is key. Application servers typically use a scale-out approach for scalability, which is virtualization friendly, but that says nothing about performance. Finding performance increases, especially when you are running on a d
2 0.68816543 1423 high scalability-2013-03-13-Iron.io Moved From Ruby to Go: 28 Servers Cut and Colossal Clusterf**ks Prevented
Introduction: For the last few months I've been programming a system in Go, so I'm always on the lookout for information to feed my confirmation bias. An opportunity popped up when Iron.io wrote about their experience using Go to rewrite IronWorker , their ever busy job execution system, originally coded in Ruby. The result: Dropped from 30 to 2 servers and the second server was used only for redundancy. CPU utilization dropped to less than 5%. Memory usage dropped. Only a "few hundred KB's of memory (on startup) vs our Rails apps which were ~50MB (on startup)". Cascading failures are now a thing of the past. New services running on hundreds of servers are all written in Go. They believe using Go allows them to "build great products, to grow and scale, and attract grade A talent. And I believe it will continue to help us grow for the foreseeable future." Picking a language based on the size of the talent pool is a common recommendation, they've found selecting Go helps them attract
3 0.68177933 924 high scalability-2010-10-21-What is Network-based Application Virtualization and Why Do You Need It?
Introduction: With all the attention being paid these days to VDI (virtual desktop infrastructure) and application virtualization and server virtualization andvirtualization it’s easy to forget about network-based application virtualization. But it’s the one virtualization technique you shouldn’t forget because it is a foundational technology upon which myriad other solutions will be enabled. WHAT IS NETWORK-BASED APPLICATION VIRTUALIZATION? This term may not be familiar to you but that’s because since its inception oh, more than a decade ago, it’s always just been called “server virtualization”. After the turn of the century (I love saying that, by the way) it was always referred to as service virtualization in SOA and XML circles. With the rise of the likes of VMware and Citrix and Microsoft server virtualization solutions, it’s become impossible to just use the term “server virtualization” and “service virtualization” is just as ambiguous so it seems appropriate to giv
Introduction: One stumbling block of the the great march towards virtualization is the relatively poor performance of resource hungry applications like databases. We are told to develop and test using VMs, but deploy without them. Which kind of sucks IMHO. Maybe better virtualization technology can remove this split. This paper talks about a different approach to virtualization called "container-based" virtualization that can reportedly double the performance of traditional hypervisor systems like Xen. It does this by trading isolation for efficiency. Rather than maintaining complete isolation between VMs the container approach shares resources between VMs and thus gives higher performance while still guaranteeing strong fault, resource, and security isolation. It's yet another battle in computing's endless war of creating and destroying abstraction layers. I learned a lot from from this paper because of how it compared and contrasted traditional hypervisor and container based virtualization strateg
5 0.65081823 1038 high scalability-2011-05-11-Troubleshooting response time problems – why you cannot trust your system metrics
Introduction: Production Monitoring is about ensuring the stability and health of our system, that also includes the application. A lot of times we encounter production systems that concentrate on System Monitoring, under the assumption that a stable system leads to stable and healthy applications. So let’s see what System Monitoring can tell us about our Application . Let’s take a very simple two tier Web Application: This is a simple multi-tier eCommerce solution. Users are concerned about bad performance when they do a search. Let's see what we can find out about it if performance is not satisfactory. We start by looking at a couple of simple metrics. CPU Utilization The best known operating system metric is CPU utilization, but it is also the most misunderstood. This metric tells us how much time the CPU spent executing code in the last interval and how much more it could execute theoretically. Like all other utilization measures it tells us something about the capaci
6 0.64247119 679 high scalability-2009-08-11-13 Scalability Best Practices
7 0.63830662 987 high scalability-2011-02-10-Dispelling the New SSL Myth
8 0.62834495 1593 high scalability-2014-02-10-13 Simple Tricks for Scaling Python and Django with Apache from HackerEarth
9 0.62094671 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
10 0.61659092 573 high scalability-2009-04-16-Serving 250M quotes-day at CNBC.com with aiCache
11 0.60423911 1063 high scalability-2011-06-17-Stuff The Internet Says On Scalability For June 17, 2011
12 0.60004526 1594 high scalability-2014-02-12-Paper: Network Stack Specialization for Performance
13 0.59952348 906 high scalability-2010-09-22-Applying Scalability Patterns to Infrastructure Architecture
14 0.59932721 1182 high scalability-2012-01-27-Stuff The Internet Says On Scalability For January 27, 2012
15 0.59851861 694 high scalability-2009-09-04-Hot Links for 2009-9-4
16 0.59115636 923 high scalability-2010-10-21-Machine VM + Cloud API - Rewriting the Cloud from Scratch
17 0.59065878 913 high scalability-2010-10-01-Hot Scalability Links For Oct 1, 2010
18 0.5877648 381 high scalability-2008-09-08-Guerrilla Capacity Planning and the Law of Universal Scalability
19 0.58635408 219 high scalability-2008-01-21-Product: Hyperic
20 0.58324224 1521 high scalability-2013-09-23-Salesforce Architecture - How they Handle 1.3 Billion Transactions a Day
topicId topicWeight
[(1, 0.163), (2, 0.23), (10, 0.031), (13, 0.221), (30, 0.015), (61, 0.063), (79, 0.161)]
simIndex simValue blogId blogTitle
1 0.91731411 1282 high scalability-2012-07-12-4 Strategies for Punching Down Traffic Spikes
Introduction: Travis Reeder in Spikability - An Application's Ability to Handle Unknown and/or Inconsistent Load gives four good ways of handling spikey loads: Have more resources than you'll ever need . Estimate the maximum traffic you'll need and keep that many servers running. Downside is you are paying for capacity you aren't using. Disable features during high loads . Reduce load by disabling features or substituting in lighter weight features. Downside is users to have access to features. Auto scaling . Launch new servers in response to load. Downsides are it's complicated to setup and slow to respond. Random spikes will cause cycling of instances going up and down. Use message queues . Queues soak up work requests during traffic spikes. More servers can be started to process work from the queue. Resources aren't wasted and features are disabled. Downside is increased latency.
2 0.91367233 758 high scalability-2010-01-11-Have We Reached the End of Scaling?
Introduction: This is an excerpt from my article Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud. Have we reached the end of scaling? That's what I asked myself one day after noticing a bunch of "The End of" headlines. We've reached The End of History because the Western liberal democracy is the "end point of humanity's sociocultural evolution and the final form of human government." We've reached The End of Science because of the "fact that there aren't going to be any obvious, cataclysmic revolutions." We've even reached The End of Theory because all answers can be found in the continuous stream of data we're collecting. And doesn't always seem like we're at The End of the World ? Motivated by the prospect of everything ending, I began to wonder: have we really reached The End of Scaling? For a while I thought this might be true. The reason I thought the End of Scaling might be near is because of the slow down of potential articles at m
3 0.91094333 477 high scalability-2008-12-29-100% on Amazon Web Services: Soocial.com - a lesson of porting your service to Amazon
Introduction: Simone Brunozzi, technology evangelist for Amazon Web Services in Europe, describes how Soocial.com was fully ported to Amazon web services. ---------------- This period of the year I decided to dedicate some time to better understand how our customers use AWS, therefore I spent some online time with Stefan Fountain and the nice guys at Soocial.com, a "one address book solution to contact management", and I would like to share with you some details of their IT infrastructure, which now runs 100% on Amazon Web Services! In the last few months, they've been working hard to cope with tens of thousands of users and to get ready to easily scale to millions. To make this possible, they decided to move ALL their architecture to Amazon Web Services. Despite the fact that they were quite happy with their previous hosting provider, Amazon proved to be the way to go. ----------------- Read the rest of the article here .
4 0.8985064 112 high scalability-2007-10-04-You Can Now Store All Your Stuff on Your Own Google Like File System
Introduction: Update : Parascale’s CTO on what’s different about Parascale . Let's say you have gigglebytes of data to store and you aren't sure you want to use a CDN . Amazon's S3 doesn't excite you. And you aren't quite ready to join the grid nation. You want to keep it all in house. Wouldn't it be nice to have something like the Google File System you could use to create a unified file system out of all your disks sitting on all your nodes? According to Robin Harris, a.k.a StorageMojo (a great blog BTW), you can now have your own GFS: Parascale launches Google-like storage software . Parascale calls their softwate a Virtual Storage Network (VSN). It "aggregates disks across commodity Linux x86 servers to deliver petabyte-scale file storage. With features such as automated, transparent file replication and file migration, Parascale eliminates storage hotspots and delivers massive read/write bandwidth." Why should you care? I don't know about you, but the "storage problem" is one
5 0.89725161 391 high scalability-2008-09-23-The 7 Stages of Scaling Web Apps
Introduction: By John Engales CTO, Rackspace. Good presentation of the stages a typical successful website goes through: Stage 1 - The Beginning: Simple architecture, low complexity. no redundancy. Firewall, load balancer, a pair of web servers, database server, and internal storage. Stage 2 - More of the same, just bigger. Stage 3 - The Pain Begins: publicity hits. Use reverse proxy, cache static content, load balancers, more databases, re-coding. Stage 4 - The Pain Intensifies: caching with memcached, writes overload and replication takes too long, start database partitioning, shared storage makes sense for content, significant re-architecting for DB. Stage 5 - This Really Hurts!: rethink entire application, partition on geography user ID, etc, create user clusters, using hashing scheme for locating which user belongs to which cluster. Stage 6 - Getting a little less painful: scalable application and database architecture, acceptable performance, starting to add ne features again, op
6 0.89443862 1070 high scalability-2011-06-29-Second Hand Seizure : A New Cause of Site Death
7 0.88487464 1576 high scalability-2014-01-10-Stuff The Internet Says On Scalability For January 10th, 2014
same-blog 8 0.88407993 664 high scalability-2009-07-29-Strategy: Devirtualize for More Vroom
9 0.87779313 34 high scalability-2007-07-27-Product: Munin Monitoriting Tool
10 0.85303468 1431 high scalability-2013-03-29-Stuff The Internet Says On Scalability For March 29, 2013
11 0.82660937 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
12 0.82658195 890 high scalability-2010-09-01-Paper: The Case for Determinism in Database Systems
13 0.82493287 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
14 0.82324082 415 high scalability-2008-10-15-Need help with your Hadoop deployment? This company may help!
15 0.82267928 1446 high scalability-2013-04-25-Paper: Making reliable distributed systems in the presence of software errors
16 0.82246155 327 high scalability-2008-05-27-How I Learned to Stop Worrying and Love Using a Lot of Disk Space to Scale
17 0.82171649 1276 high scalability-2012-07-04-Top Features of a Scalable Database
18 0.82161075 1654 high scalability-2014-06-05-Cloud Architecture Revolution
19 0.82103229 15 high scalability-2007-07-16-Blog: MySQL Performance Blog - Everything about MySQL Performance.
20 0.82057452 254 high scalability-2008-02-19-Hadoop Getting Closer to 1.0 Release