high_scalability high_scalability-2010 high_scalability-2010-824 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Since its inception, Amazon EC2 has enabled companies to run highly scalable infrastructure with minimal overhead. Over the years, Amazon Web Services has expanded with new offerings and additional regions around the world. All this growth has made establishing a global footprint easier than ever. And yet, most EC2 customers still choose to operate in a single region. While this is fine for many applications, customers with significant web infrastructure are depriving users of drastically improved performance. Deploying infrastructure in EC2's new regions cuts out one of the biggest sources of latency: distance. In this post , I describe how Bizo significantly reduced load times by implementing Global Server Load Balancing (GSLB) to distribute traffic across all Amazon regions. Click here to read more on Bizo's dev blog
sentIndex sentText sentNum sentScore
1 Since its inception, Amazon EC2 has enabled companies to run highly scalable infrastructure with minimal overhead. [sent-1, score-0.638]
2 Over the years, Amazon Web Services has expanded with new offerings and additional regions around the world. [sent-2, score-0.926]
3 All this growth has made establishing a global footprint easier than ever. [sent-3, score-0.858]
4 And yet, most EC2 customers still choose to operate in a single region. [sent-4, score-0.473]
5 While this is fine for many applications, customers with significant web infrastructure are depriving users of drastically improved performance. [sent-5, score-1.012]
6 Deploying infrastructure in EC2's new regions cuts out one of the biggest sources of latency: distance. [sent-6, score-0.97]
7 In this post , I describe how Bizo significantly reduced load times by implementing Global Server Load Balancing (GSLB) to distribute traffic across all Amazon regions. [sent-7, score-0.819]
wordName wordTfidf (topN-words)
[('regions', 0.303), ('gslb', 0.258), ('bizo', 0.258), ('establishing', 0.234), ('drastically', 0.215), ('expanded', 0.211), ('footprint', 0.201), ('cuts', 0.193), ('offerings', 0.183), ('infrastructure', 0.177), ('customers', 0.171), ('enabled', 0.165), ('global', 0.163), ('dev', 0.155), ('minimal', 0.149), ('describe', 0.144), ('reduced', 0.135), ('distribute', 0.134), ('operate', 0.132), ('improved', 0.132), ('sources', 0.129), ('deploying', 0.128), ('fine', 0.127), ('amazon', 0.124), ('implementing', 0.12), ('significant', 0.12), ('choose', 0.117), ('biggest', 0.111), ('additional', 0.11), ('easier', 0.097), ('balancing', 0.096), ('growth', 0.095), ('load', 0.093), ('blog', 0.093), ('yet', 0.083), ('companies', 0.078), ('since', 0.077), ('years', 0.076), ('traffic', 0.07), ('web', 0.07), ('highly', 0.069), ('made', 0.068), ('latency', 0.065), ('times', 0.065), ('around', 0.062), ('post', 0.058), ('services', 0.057), ('new', 0.057), ('read', 0.053), ('still', 0.053)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 824 high scalability-2010-05-06-Going global on EC2
Introduction: Since its inception, Amazon EC2 has enabled companies to run highly scalable infrastructure with minimal overhead. Over the years, Amazon Web Services has expanded with new offerings and additional regions around the world. All this growth has made establishing a global footprint easier than ever. And yet, most EC2 customers still choose to operate in a single region. While this is fine for many applications, customers with significant web infrastructure are depriving users of drastically improved performance. Deploying infrastructure in EC2's new regions cuts out one of the biggest sources of latency: distance. In this post , I describe how Bizo significantly reduced load times by implementing Global Server Load Balancing (GSLB) to distribute traffic across all Amazon regions. Click here to read more on Bizo's dev blog
2 0.10714032 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
Introduction: Can you really create an infinitely scalable infrastructure for less than $100 using Amazon's storage, grid, and queuing services platform? It appears so, at least for the right application. Amazon beams a spot light on the future battle of the roll-your-own versus the connect-the-dots approach to building next generation websites using core external services. Their argument is strong. Using Amazon's platform you can quickly build an infrastructure that would otherwise take an eternity to make, a pile of money to create, and an unbounded mass of people to implement and maintain. Yet Amazon doesn't provide SLAs, so you can you really trust them with your crown jewels? Facebook recently leap frogged Amazon's vision with an even more comprehensive set of services. The battle for the future is on. Site: http://aws.amazon.com/ Information Sources Slides: Building Highly Scalable Web Applications Podcast: Technometria: Amazon Web Services Amazon Services Home . Platform
Introduction: CDNs ( content delivery networks ) are the secret shadow super powers behind the web and Dan Rayburn at streamingmedia.com is the go to investigative reporter for quality information on CDNs. Every year Dan has a Content Delivery Summit on all things CDN and those videos are now available . Dan also gives a kind of state of the industry talk where he does something wonderful, he gives real numbers and prices. Dan really knows his stuff and is an excellent speaker, so watch the video, but here’s my gloss on the state of the CDN so far this year: Massive growth . Large customers are expecting 126% growth in video traffic over last year; medium size customers are seeing 48% traffic growth, small sized customer are seeing 73.3% traffic growth. More traffic != More profit . Traffic growth doesn’t lead to more profit because the traffic growth is concentrated in larger customers that can make the best deals. Video takes up the largest amount of traffic on a
4 0.1017819 96 high scalability-2007-09-18-Amazon Architecture
Introduction: This is a wonderfully informative Amazon update based on Joachim Rohde's discovery of an interview with Amazon's CTO. You'll learn about how Amazon organizes their teams around services, the CAP theorem of building scalable systems, how they deploy software, and a lot more. Many new additions from the ACM Queue article have also been included. Amazon grew from a tiny online bookstore to one of the largest stores on earth. They did it while pioneering new and interesting ways to rate, review, and recommend products. Greg Linden shared is version of Amazon's birth pangs in a series of blog articles Site: http://amazon.com Information Sources Early Amazon by Greg Linden How Linux saved Amazon millions Interview Werner Vogels - Amazon's CTO Asynchronous Architectures - a nice summary of Werner Vogels' talk by Chris Loosley Learning from the Amazon technology platform - A Conversation with Werner Vogels Werner Vogels' Weblog - building scalable and robus
5 0.096562713 427 high scalability-2008-10-22-Server load balancing architectures, Part 2: Application-level load balancing
Introduction: The transport-level server load balancing architectures described in the first half of this article are more than adequate for many Web sites, but more complex and dynamic sites can't depend on them. Applications that rely on cache or session data must be able to handle a sequence of requests from the same client accurately and efficiently, without failing. In this follow up to his introduction to server load balancing, Gregor Roth discusses various application-level load balancing architectures, helping you decide which one will best meet the business requirements of your Web site. The first half of this article describes transport-level server load balancing solutions, such as TCP/IP-based load balancers, and analyzes their benefits and disadvantages. Load balancing on the TCP/IP level spreads incoming TCP connections over the real servers in a server farm. It is sufficient in most cases, especially for static Web sites. However, support for dynamic Web sites often re
6 0.093548641 1188 high scalability-2012-02-06-The Design of 99designs - A Clean Tens of Millions Pageviews Architecture
7 0.093472563 1123 high scalability-2011-09-23-The Real News is Not that Facebook Serves Up 1 Trillion Pages a Month…
8 0.087631643 389 high scalability-2008-09-23-How to Scale with Ruby on Rails
9 0.087577984 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
10 0.08742021 1329 high scalability-2012-09-26-WordPress.com Serves 70,000 req-sec and over 15 Gbit-sec of Traffic using NGINX
11 0.08672411 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
12 0.086294383 1557 high scalability-2013-12-02-Evolution of Bazaarvoice’s Architecture to 500M Unique Users Per Month
13 0.085836731 426 high scalability-2008-10-22-Server load balancing architectures, Part 1: Transport-level load balancing
14 0.082266994 241 high scalability-2008-02-05-SLA monitoring
15 0.078164078 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
16 0.077732675 661 high scalability-2009-07-25-Latency is Everywhere and it Costs You Sales - How to Crush it
17 0.077270269 214 high scalability-2008-01-15-Sun to Acquire MySQL
18 0.076322757 906 high scalability-2010-09-22-Applying Scalability Patterns to Infrastructure Architecture
19 0.075797454 577 high scalability-2009-04-22-Gear6 Web cache - the hardware solution for working with Memcache
20 0.073970534 1325 high scalability-2012-09-19-The 4 Building Blocks of Architecting Systems for Scale
topicId topicWeight
[(0, 0.131), (1, 0.022), (2, -0.005), (3, -0.014), (4, -0.034), (5, -0.071), (6, -0.006), (7, -0.102), (8, -0.004), (9, -0.002), (10, -0.007), (11, -0.005), (12, -0.007), (13, -0.044), (14, -0.035), (15, 0.004), (16, 0.05), (17, -0.029), (18, 0.039), (19, 0.017), (20, 0.026), (21, 0.052), (22, 0.022), (23, -0.021), (24, 0.019), (25, 0.018), (26, -0.032), (27, 0.02), (28, 0.013), (29, -0.009), (30, 0.039), (31, -0.012), (32, 0.023), (33, -0.037), (34, 0.016), (35, -0.018), (36, -0.005), (37, -0.001), (38, 0.002), (39, -0.076), (40, 0.043), (41, 0.032), (42, 0.016), (43, -0.042), (44, 0.02), (45, 0.05), (46, 0.024), (47, -0.063), (48, 0.018), (49, -0.037)]
simIndex simValue blogId blogTitle
same-blog 1 0.98329353 824 high scalability-2010-05-06-Going global on EC2
Introduction: Since its inception, Amazon EC2 has enabled companies to run highly scalable infrastructure with minimal overhead. Over the years, Amazon Web Services has expanded with new offerings and additional regions around the world. All this growth has made establishing a global footprint easier than ever. And yet, most EC2 customers still choose to operate in a single region. While this is fine for many applications, customers with significant web infrastructure are depriving users of drastically improved performance. Deploying infrastructure in EC2's new regions cuts out one of the biggest sources of latency: distance. In this post , I describe how Bizo significantly reduced load times by implementing Global Server Load Balancing (GSLB) to distribute traffic across all Amazon regions. Click here to read more on Bizo's dev blog
2 0.75172704 477 high scalability-2008-12-29-100% on Amazon Web Services: Soocial.com - a lesson of porting your service to Amazon
Introduction: Simone Brunozzi, technology evangelist for Amazon Web Services in Europe, describes how Soocial.com was fully ported to Amazon web services. ---------------- This period of the year I decided to dedicate some time to better understand how our customers use AWS, therefore I spent some online time with Stefan Fountain and the nice guys at Soocial.com, a "one address book solution to contact management", and I would like to share with you some details of their IT infrastructure, which now runs 100% on Amazon Web Services! In the last few months, they've been working hard to cope with tens of thousands of users and to get ready to easily scale to millions. To make this possible, they decided to move ALL their architecture to Amazon Web Services. Despite the fact that they were quite happy with their previous hosting provider, Amazon proved to be the way to go. ----------------- Read the rest of the article here .
3 0.74609274 509 high scalability-2009-02-05-Product: HAProxy - The Reliable, High Performance TCP-HTTP Load Balancer
Introduction: Update: Load Balancing in Amazon EC2 with HAProxy. Grig Gheorghiu writes a nice post on HAProxy functionality and configuration: Emulating virtual servers, Logging, SSL, Load balancing algorithms, Session persistence with cookies, Server health checks, etc. Adapted From the website: HAProxy is a free, very fast and reliable solution offering high availability, load balancing, and proxying for TCP and HTTP-based applications. It is particularly suited for web sites crawling under very high loads while needing persistence or Layer7 processing. Supporting tens of thousands of connections is clearly realistic with todays hardware. Its mode of operation makes its integration into existing architectures very easy and riskless, while still offering the possibility not to expose fragile web servers to the Net. Currently, two major versions are supported : * version 1.1 - maintains critical sites online since 200 The most stable and reliable, has reached years of uptime. Receive
4 0.72865897 300 high scalability-2008-04-07-Scalr - Open Source Auto-scaling Hosting on Amazon EC2
Introduction: Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2. It has been recently open sourced on Google Code. Scalr allows you to create server farms through a web-based interface using prebuilt AMI's for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of. Scalr promises automatic high-availability and scaling for developers by health and load monitoring. The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it. 4 AMI's are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle t
5 0.7201466 79 high scalability-2007-09-01-On-Demand Infinitely Scalable Database Seed the Amazon EC2 Cloud
Introduction: Amazon's EC2 sounds good, but how do you make use of all that throbbing CPU power? A few companies are stepping up to fill the how-to gap. Elastra provides unlimited on-demand creation of MySQL and PostgresSQL instances for $.50/server/hour. They contend their clusters perform "nearly" as well as a local database deployed using local storage. RightScale says they "enable you to run your entire web business on Amazon Web Services with reliability, scalability and performance – and pushbutton control of complex system administration tasks." This includes web servers, DNS, and MySQL services. Prices start at $500 a month. Later I'll write more about these and other related services like 3tera , but these services are the canary in the coal mine, the face of change, the bellwether of the new data center. How we build scalable web sites is about to change.
6 0.70815337 452 high scalability-2008-12-01-An Open Source Web Solution - Lighttpd Web Server and Chip Multithreading Technology
7 0.68077356 1557 high scalability-2013-12-02-Evolution of Bazaarvoice’s Architecture to 500M Unique Users Per Month
8 0.680372 1260 high scalability-2012-06-07-Case Study on Scaling PaaS infrastructure
10 0.67600501 427 high scalability-2008-10-22-Server load balancing architectures, Part 2: Application-level load balancing
11 0.6733461 1329 high scalability-2012-09-26-WordPress.com Serves 70,000 req-sec and over 15 Gbit-sec of Traffic using NGINX
12 0.66662145 1325 high scalability-2012-09-19-The 4 Building Blocks of Architecting Systems for Scale
13 0.6468659 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
14 0.63513166 1296 high scalability-2012-08-02-Strategy: Use Spare Region Capacity to Survive Availability Zone Failures
15 0.63282186 1188 high scalability-2012-02-06-The Design of 99designs - A Clean Tens of Millions Pageviews Architecture
16 0.62861061 760 high scalability-2010-01-13-10 Hot Scalability Links for January 13, 2010
17 0.62600601 539 high scalability-2009-03-16-Books: Web 2.0 Architectures and Cloud Application Architectures
18 0.62530082 501 high scalability-2009-01-25-Where do I start?
19 0.62068182 1155 high scalability-2011-12-12-Netflix: Developing, Deploying, and Supporting Software According to the Way of the Cloud
20 0.61475086 426 high scalability-2008-10-22-Server load balancing architectures, Part 1: Transport-level load balancing
topicId topicWeight
[(1, 0.275), (2, 0.127), (11, 0.225), (61, 0.075), (85, 0.141), (94, 0.035)]
simIndex simValue blogId blogTitle
1 0.87963957 457 high scalability-2008-12-01-Sun FireTM X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software
Introduction: Sun FireTM X4540 Server as Backup Server for Zmanda's Amanda Enterprise 2.6 Software by Thomas Hanvey (Sun Microsystems) and Dmitri Joukovski and Ken Crandall (Zmanda) September, 2008 Explosive data growth, combined with demanding requirements for data availability, has placed a tremendous burden on IT operations staff at businesses of all sizes. Yet, many organizations do not have the staff or budget to purchase and manage complex and expensive backup and recovery software products. The Sun FireTM X4540 server can deliver massive storage capacity and remarkable throughput so it is well-suited as a nearline storage platform for backup and restore applications. Combining the power of the SolarisTM 10 Operating System with the data integrity and simplified administration of ZFS, the Sun Fire X4540 server can be an ideal candidate for streamlining and improving backup and restore operations. Amanda Enterprise Edition from Zmanda was designed to address these challenges,
2 0.87196237 668 high scalability-2009-08-01-15 Scalability and Performance Best Practices
Introduction: These are from Laura Thomson of OmniTi : Profile early, profile often. Pick a profiling tool and learn it in and out. Dev-ops cooperation is essential. The most critical difference in organizations that handles crises well. Test on production data. Code behavior (especially performance) is often data driven. Track and trend. Understanding your historical performance characteristics is essential for spotting emerging problems. Assumptions will burn you. Systems are complex and often break in unexpected ways. Decouple. Isolate performance failures. Cache. Caching is the core of most optimizations. Federate. Data federation is taking a single data set and spreading it across multiple database/application servers. Replicate. Replication is making synchronized copies of data available in more than one place. Avoid straining hard-to-scale resources. Some resources are inherently hard to scale: Uncacheable’ data, Data with a very high read+write rate
same-blog 3 0.84781289 824 high scalability-2010-05-06-Going global on EC2
Introduction: Since its inception, Amazon EC2 has enabled companies to run highly scalable infrastructure with minimal overhead. Over the years, Amazon Web Services has expanded with new offerings and additional regions around the world. All this growth has made establishing a global footprint easier than ever. And yet, most EC2 customers still choose to operate in a single region. While this is fine for many applications, customers with significant web infrastructure are depriving users of drastically improved performance. Deploying infrastructure in EC2's new regions cuts out one of the biggest sources of latency: distance. In this post , I describe how Bizo significantly reduced load times by implementing Global Server Load Balancing (GSLB) to distribute traffic across all Amazon regions. Click here to read more on Bizo's dev blog
4 0.81914163 25 high scalability-2007-07-25-Paper: Designing Disaster Tolerant High Availability Clusters
Introduction: A very detailed (339 pages) paper on how to use HP products to create a highly available cluster. It's somewhat dated and obviously concentrates on HP products, but it is still good information. Table of contents: 1. Disaster Tolerance and Recovery in a Serviceguard Cluster 2. Building an Extended Distance Cluster Using ServiceGuard 3. Designing a Metropolitan Cluster 4. Designing a Continental Cluster 5. Building Disaster-Tolerant Serviceguard Solutions Using Metrocluster with Continuous Access XP 6. Building Disaster Tolerant Serviceguard Solutions Using Metrocluster with EMC SRDF 7. Cascading Failover in a Continental Cluster Evaluating the Need for Disaster Tolerance What is a Disaster Tolerant Architecture? Types of Disaster Tolerant Clusters Extended Distance Clusters Metropolitan Cluster Continental Cluster Continental Cluster With Cascading Failover Disaster Tolerant Architecture Guidelines Protecting Nodes through Geographic Dispersion Protecting Data th
5 0.81112063 646 high scalability-2009-07-01-Podcast about Facebook's Cassandra Project and the New Wave of Distributed Databases
Introduction: In this podcast , we interview Jonathan Ellis about how Facebook's open sourced Cassandra Project took lessons learned from Amazon's Dynamo and Google's BigTable to tackle the difficult problem of building a highly scalable, always available, distributed data store.
6 0.80618536 466 high scalability-2008-12-16-Facebook is Hiring
7 0.78702146 46 high scalability-2007-07-30-Product: Sun Utility Computing
8 0.77688909 53 high scalability-2007-08-01-Product: MogileFS
9 0.77665949 492 high scalability-2009-01-16-Database Sharding for startups
10 0.77309179 424 high scalability-2008-10-22-EVE Online Architecture
11 0.77191037 194 high scalability-2007-12-26-Golden rule of web caching
12 0.76327443 603 high scalability-2009-05-19-Scaling Memcached: 500,000+ Operations-Second with a Single-Socket UltraSPARC T2
13 0.7613377 720 high scalability-2009-10-12-High Performance at Massive Scale – Lessons learned at Facebook
14 0.76110226 1082 high scalability-2011-07-18-New Relic Architecture - Collecting 20+ Billion Metrics a Day
15 0.76024115 296 high scalability-2008-04-03-Development of highly scalable web site
16 0.76015252 755 high scalability-2009-12-28-Zynga Needs a Server-side Systems Engineer
17 0.75825369 924 high scalability-2010-10-21-What is Network-based Application Virtualization and Why Do You Need It?
18 0.75758886 632 high scalability-2009-06-15-starting small with growth in mind
19 0.75556809 1236 high scalability-2012-04-30-Masstree - Much Faster than MongoDB, VoltDB, Redis, and Competitive with Memcached
20 0.75510925 442 high scalability-2008-11-13-Plenty of Fish Says Scaling for Free Doesn't Pay