high_scalability high_scalability-2008 high_scalability-2008-300 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2. It has been recently open sourced on Google Code. Scalr allows you to create server farms through a web-based interface using prebuilt AMI's for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of. Scalr promises automatic high-availability and scaling for developers by health and load monitoring. The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it. 4 AMI's are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle t
sentIndex sentText sentNum sentScore
1 Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2. [sent-1, score-0.218]
2 It has been recently open sourced on Google Code. [sent-2, score-0.101]
3 Scalr allows you to create server farms through a web-based interface using prebuilt AMI's for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of. [sent-3, score-0.845]
4 Scalr promises automatic high-availability and scaling for developers by health and load monitoring. [sent-4, score-0.529]
5 The health of the farm is continuously monitored and maintained. [sent-5, score-0.541]
6 When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. [sent-6, score-1.273]
7 When a node crashes a new machine of that type is inserted into the farm to replace it. [sent-7, score-1.071]
8 4 AMI's are provided for load balancers, mysql databases, application servers, and a generic base image to customize. [sent-8, score-0.662]
9 Scalr allows you to further customize each image, bundle the image and use that for future nodes that are inserted into the farm. [sent-9, score-0.791]
10 You can make changes to one machine and use that for a specific type of node. [sent-10, score-0.252]
11 New machines of this type will be brought online to meet current levels and the old machines are terminated one by one. [sent-11, score-0.549]
12 The open source scalr platform with the combination of the static EC2 IP addresses makes elastic computing easier to implement. [sent-12, score-0.481]
13 As AWS conquers the scalable web application hosting space it is time to check out the new Programming Amazon Web Services: S3, EC2, SQS, FPS, and SimpleDB (Programming) book on amazon. [sent-14, score-0.44]
14 What do you think of the opportunities of using scalr for automatic scalability? [sent-16, score-0.561]
wordName wordTfidf (topN-words)
[('ami', 0.343), ('scalr', 0.343), ('inserted', 0.312), ('farm', 0.204), ('image', 0.18), ('type', 0.18), ('generic', 0.168), ('health', 0.16), ('balancers', 0.157), ('automatic', 0.153), ('fps', 0.151), ('conquers', 0.151), ('prebuilt', 0.151), ('node', 0.137), ('terminated', 0.135), ('load', 0.122), ('customize', 0.117), ('hosting', 0.114), ('pound', 0.112), ('bundle', 0.105), ('others', 0.105), ('check', 0.105), ('monitored', 0.104), ('utilizing', 0.104), ('sourced', 0.101), ('farms', 0.1), ('sqs', 0.096), ('crashes', 0.094), ('promises', 0.094), ('threshold', 0.093), ('simpledb', 0.089), ('configurable', 0.088), ('machines', 0.081), ('allows', 0.077), ('continuously', 0.073), ('addresses', 0.073), ('replace', 0.072), ('brought', 0.072), ('machine', 0.072), ('nginx', 0.071), ('databases', 0.07), ('book', 0.07), ('mysql', 0.066), ('opportunities', 0.065), ('amazon', 0.065), ('elastic', 0.065), ('ip', 0.064), ('provided', 0.064), ('redundant', 0.064), ('base', 0.062)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 300 high scalability-2008-04-07-Scalr - Open Source Auto-scaling Hosting on Amazon EC2
Introduction: Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2. It has been recently open sourced on Google Code. Scalr allows you to create server farms through a web-based interface using prebuilt AMI's for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of. Scalr promises automatic high-availability and scaling for developers by health and load monitoring. The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it. 4 AMI's are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle t
2 0.27950105 798 high scalability-2010-03-22-7 Secrets to Successfully Scaling with Scalr (on Amazon) by Sebastian Stadil
Introduction: This is a part interview part guest with Sebastian Stadil, founder of Scalr , a cheaper open-source version of RightScale. Scalr takes care of all the web site infrastructure bits to on Amazon (and other clouds) so you don’t have to. I first met Sebastian at one of the original Silicon Valley Cloud Computing Group meetups, a group which he founded. The meetings started in the tiny offices of Intalio where Sebastian was working with this new fangled Amazon thing to create an auto-scaling server farm on EC2. I remember distinctly how Sebastian met everyone at the door with a handshake and a smile, making us all feel welcome. Later I took one of the classes he created on how to use AWS. I guess he figured all this cloud stuff was going somewhere and decided to start Scalr. My only regret about this post is that the name Amazon does not begin with the letter ‘S’, that would have made for an epic title. Getting to Know You In this section are the responses Sebastian gave to a few
3 0.14197026 138 high scalability-2007-10-30-Feedblendr Architecture - Using EC2 to Scale
Introduction: A man had a dream. His dream was to blend a bunch of RSS/Atom/RDF feeds into a single feed. The man is Beau Lebens of Feedville and like most dreamers he was a little short on coin. So he took refuge in the home of a cheap hosting provider and Beau realized his dream, creating FEEDblendr . But FEEDblendr chewed up so much CPU creating blended feeds that the cheap hosting provider ordered Beau to find another home. Where was Beau to go? He eventually found a new home in the virtual machine room of Amazon's EC2. This is the story of how Beau was finally able to create his one feeds safe within the cradle of affordable CPU cycles. Site: http://feedblendr.com/ The Platform EC2 (Fedora Core 6 Lite distro) S3 Apache PHP MySQL DynDNS (for round robin DNS) The Stats Beau is a developer with some sysadmin skills, not a web server admin, so a lot of learning was involved in creating FEEDblendr. FEEDblendr uses 2 EC2 instances. The same Amazon Instance (AMI) is
4 0.12827519 1470 high scalability-2013-06-05-A Simple 6 Step Transition Guide for Moving Away from X to AWS
Introduction: If you just want to visit Rome and not go full on Cloud Native like Netflix, then Soundslice 's Adrian Holovaty in Why I left Heroku, and notes on my new AWS setup provides a simple guide for helping make your first trip a good one. First, let's dispose of why Soundslice left Heroku. The essence is because of various issues "Heroku lost my trust." YMMV, but once a fact, what do you do? After a consultation with Scott VanDenPlas , former director of dev ops for the Obama reelection tech team, they came up a simple transition guide that I think is quite good and generally useful (full details in the original post ): Bake an AMI . Install all the stuff you need on an AMI and use that as your deployment unit. This works well for Netflix and for users who value a certain sort of simplicity more than flexibility. There were a lot of comments saying how it's better to use Chef/Puppet and configure instances on the fly, but there's a confidence that only a baked image provides
5 0.11299543 1058 high scalability-2011-06-13-Automation on AWS with Ruby and Puppet
Introduction: This is a guest post by Frédéric Faure (architect at Ysance ), you can follow him on twitter . Urbandive is an immersive view service launched by the French YellowPages which allows you to travel in cities in France thanks to a 360° view. Urbandive focuses on providing high definition pictures and accurate professional and social content. One of the biggest jobs was to enable a fast scalable architecture, because it was really difficult to forecast the traffic load at production time. Traffic load may be influenced if the service receives attention from users as a result of advertising. Below you will find a summary of the goals we achieve by using a Ruby scheduler built on top of Puppet on AWS to create a complete infrastructure. Workflow & XTR-Lucid Our scalability combo is : a home-made Ruby scheduler ( XTR-Lucid ) to deal with AWS APIs + the Puppet Master to install services and configure EC2 instances and keep them up-to-date during all the product
6 0.10926287 1329 high scalability-2012-09-26-WordPress.com Serves 70,000 req-sec and over 15 Gbit-sec of Traffic using NGINX
7 0.10751837 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
8 0.10646333 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
9 0.10347313 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
10 0.10265251 314 high scalability-2008-05-03-Product: nginx
11 0.10017003 184 high scalability-2007-12-13-Amazon SimpleDB - Scalable Cloud Database
12 0.09863624 881 high scalability-2010-08-16-Scaling an AWS infrastructure - Tools and Patterns
13 0.095900536 263 high scalability-2008-02-27-Product: System Imager - Automate Deployment and Installs
15 0.092088833 775 high scalability-2010-02-10-ElasticSearch - Open Source, Distributed, RESTful Search Engine
16 0.091449171 1331 high scalability-2012-10-02-An Epic TripAdvisor Update: Why Not Run on the Cloud? The Grand Experiment.
17 0.089964725 619 high scalability-2009-06-05-HotPads Shows the True Cost of Hosting on Amazon
18 0.087920792 808 high scalability-2010-04-12-Poppen.de Architecture
19 0.087001696 290 high scalability-2008-03-28-How to Get DNS Names of a Web Server
20 0.086323127 498 high scalability-2009-01-20-Product: Amazon's SimpleDB
topicId topicWeight
[(0, 0.14), (1, 0.045), (2, 0.015), (3, -0.039), (4, -0.049), (5, -0.027), (6, 0.022), (7, -0.146), (8, 0.018), (9, -0.011), (10, 0.001), (11, -0.041), (12, 0.034), (13, -0.093), (14, 0.003), (15, -0.028), (16, 0.017), (17, -0.018), (18, 0.031), (19, 0.003), (20, -0.004), (21, 0.043), (22, -0.039), (23, -0.024), (24, 0.059), (25, 0.046), (26, 0.052), (27, 0.029), (28, -0.021), (29, -0.013), (30, -0.004), (31, -0.028), (32, -0.02), (33, 0.014), (34, 0.023), (35, -0.077), (36, 0.006), (37, 0.007), (38, -0.019), (39, -0.054), (40, -0.001), (41, -0.007), (42, 0.052), (43, -0.007), (44, -0.01), (45, 0.135), (46, 0.019), (47, -0.001), (48, 0.032), (49, 0.01)]
simIndex simValue blogId blogTitle
same-blog 1 0.96482217 300 high scalability-2008-04-07-Scalr - Open Source Auto-scaling Hosting on Amazon EC2
Introduction: Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2. It has been recently open sourced on Google Code. Scalr allows you to create server farms through a web-based interface using prebuilt AMI's for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of. Scalr promises automatic high-availability and scaling for developers by health and load monitoring. The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it. 4 AMI's are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle t
2 0.72991586 138 high scalability-2007-10-30-Feedblendr Architecture - Using EC2 to Scale
Introduction: A man had a dream. His dream was to blend a bunch of RSS/Atom/RDF feeds into a single feed. The man is Beau Lebens of Feedville and like most dreamers he was a little short on coin. So he took refuge in the home of a cheap hosting provider and Beau realized his dream, creating FEEDblendr . But FEEDblendr chewed up so much CPU creating blended feeds that the cheap hosting provider ordered Beau to find another home. Where was Beau to go? He eventually found a new home in the virtual machine room of Amazon's EC2. This is the story of how Beau was finally able to create his one feeds safe within the cradle of affordable CPU cycles. Site: http://feedblendr.com/ The Platform EC2 (Fedora Core 6 Lite distro) S3 Apache PHP MySQL DynDNS (for round robin DNS) The Stats Beau is a developer with some sysadmin skills, not a web server admin, so a lot of learning was involved in creating FEEDblendr. FEEDblendr uses 2 EC2 instances. The same Amazon Instance (AMI) is
3 0.71838111 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
Introduction: Amazon is fixing two of their major problems: no static IP addresses and single datacenter operation. By adding these two new features developers can finally build a no apology system on Amazon. Before you always had to throw in an apology or two. No, we don't have low failover times because of the silly DNS games and unexceptionable DNS update and propagation times and no, we don't operate in more than one datacenter. No more. Now Amazon is adding Elastic IP Addresses and Availability Zones . Elastic IP addresses are far better than normal IP addresses because they are both in tight with Jessica Alba and they are: Static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it. Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or availability zone failures by programmatica
4 0.68932116 824 high scalability-2010-05-06-Going global on EC2
Introduction: Since its inception, Amazon EC2 has enabled companies to run highly scalable infrastructure with minimal overhead. Over the years, Amazon Web Services has expanded with new offerings and additional regions around the world. All this growth has made establishing a global footprint easier than ever. And yet, most EC2 customers still choose to operate in a single region. While this is fine for many applications, customers with significant web infrastructure are depriving users of drastically improved performance. Deploying infrastructure in EC2's new regions cuts out one of the biggest sources of latency: distance. In this post , I describe how Bizo significantly reduced load times by implementing Global Server Load Balancing (GSLB) to distribute traffic across all Amazon regions. Click here to read more on Bizo's dev blog
5 0.66190308 798 high scalability-2010-03-22-7 Secrets to Successfully Scaling with Scalr (on Amazon) by Sebastian Stadil
Introduction: This is a part interview part guest with Sebastian Stadil, founder of Scalr , a cheaper open-source version of RightScale. Scalr takes care of all the web site infrastructure bits to on Amazon (and other clouds) so you don’t have to. I first met Sebastian at one of the original Silicon Valley Cloud Computing Group meetups, a group which he founded. The meetings started in the tiny offices of Intalio where Sebastian was working with this new fangled Amazon thing to create an auto-scaling server farm on EC2. I remember distinctly how Sebastian met everyone at the door with a handshake and a smile, making us all feel welcome. Later I took one of the classes he created on how to use AWS. I guess he figured all this cloud stuff was going somewhere and decided to start Scalr. My only regret about this post is that the name Amazon does not begin with the letter ‘S’, that would have made for an epic title. Getting to Know You In this section are the responses Sebastian gave to a few
6 0.65335441 1329 high scalability-2012-09-26-WordPress.com Serves 70,000 req-sec and over 15 Gbit-sec of Traffic using NGINX
7 0.63994735 509 high scalability-2009-02-05-Product: HAProxy - The Reliable, High Performance TCP-HTTP Load Balancer
9 0.63719016 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
10 0.6357649 1260 high scalability-2012-06-07-Case Study on Scaling PaaS infrastructure
11 0.63022631 1615 high scalability-2014-03-19-Strategy: Three Techniques to Survive Traffic Surges by Quickly Scaling Your Site
12 0.62760508 878 high scalability-2010-08-12-Strategy: Terminate SSL Connections in Hardware and Reduce Server Count by 40%
13 0.62346309 1325 high scalability-2012-09-19-The 4 Building Blocks of Architecting Systems for Scale
14 0.62043607 29 high scalability-2007-07-25-Product: lighttpd
15 0.61633825 109 high scalability-2007-10-03-Save on a Load Balancer By Using Client Side Load Balancing
16 0.61580521 227 high scalability-2008-01-28-Howto setup GFS-GNBD
17 0.61502361 79 high scalability-2007-09-01-On-Demand Infinitely Scalable Database Seed the Amazon EC2 Cloud
18 0.61062354 168 high scalability-2007-11-30-Strategy: Efficiently Geo-referencing IPs
19 0.60598636 228 high scalability-2008-01-28-Product: ISPMan Centralized ISP Management System
20 0.60329658 290 high scalability-2008-03-28-How to Get DNS Names of a Web Server
topicId topicWeight
[(1, 0.129), (2, 0.149), (30, 0.011), (40, 0.321), (61, 0.104), (79, 0.082), (85, 0.012), (94, 0.089)]
simIndex simValue blogId blogTitle
1 0.93107301 860 high scalability-2010-07-17-Hot Scalability Links for July 17, 2010
Introduction: And by hot I also mean temperature. Summer has arrived. It's sizzling here in Silicon Valley. Thank you air conditioning! Scale the web by appointing a Crawler Czar? Tom Foremski has the idea that Google should open up their index so sites wouldn't have to endure the constant pounding by ravenous crawler bots. Don MacAskill of SmugMug estimates 50% of our web server CPU resources are spent serving crawlers. What a waste. How this would all work with real-time feeds, paid feeds (Twitter, movies, ...), etc. is unknown, but does it make sense for all that money to be spent on extracting the same data over and over again? Tweets of Gold: jamesurquhart : Key to applications is architecture. Key for infrastructure supporting archs is configurability. Configurability==features . tjake : People who choose their datastore based oh hearsay and not their own evaluation are doomed . b6n : No global lock ever goes unpunished. MichaelSurt
2 0.90453005 1419 high scalability-2013-03-07-It's a VM Wasteland - A Near Optimal Packing of VMs to Machines Reduces TCO by 22%
Introduction: In Algorithm Design for Performance Aware VM Consolidation we learn some shocking facts (gambling in Casablanca?): Average server utilization in many data centers is low, estimated between 5% and 15%. This is wasteful because an idle server often consumes more than 50% of peak power. Surely that's just for old style datacenters? Nope. In Google data centers, workloads that are consolidated use only 50% of the processor cores. Every other processor core is left unused simply to ensure that performance does not degrade. It's a VM wasteland. The goal is to reduce waste by packing VMs onto machines without hurting performance or wasting resources. The idea is to select VMs that interfere the least with each other and places them together on the same server. It's a NP-Complete problem, but this paper describes a practical method that performs provably close to the optimal. Interestingly they can optimize for performance or power efficiency, so you can use different algorithm
3 0.9040134 338 high scalability-2008-06-02-Total Cost of Ownership for different web development frameworks
Introduction: I would like to compile a comparison matrix on the total cost of ownership for .Net, Java, Lamp & Rails. Where should I start? Has anyone seen or know of a recent study on this subject?
4 0.8961069 27 high scalability-2007-07-25-Product: 3 PAR REMOTE COPY
Introduction: 3PAR Remote Copy is a uniquely simple and efficient replication technology that allows customers to protect and share any application data affordably. Built upon 3PAR Thin Copy technology, Remote Copy lowers the total cost of storage by addressing the cost and complexity of remote replication. Common Uses of 3PAR Remote Copy: Affordable Disaster Recovery: Mirror data cost-effectively across town or across the world. Centralized Archive: Replicate data from multiple 3PAR InServs located in multiple data centers to a centralized data archive location. Resilient Pod Architecture: Mutually replicate tier 1 or 2 data to tier 3 capacity between two InServs (application pods). Remote Data Access: Replicate data to a remote location for sharing of data with remote users.
5 0.88397074 1466 high scalability-2013-05-29-Amazon: Creating a Customer Utopia One Culture Hack at a Time
Introduction: If you don’t cannibalize yourself, someone else will. -- Steve Jobs America as the New World has a long history of inspiring Utopian communities . Early experiments were famously religious. But there have been many others as new waves of thought have inspired people to organize and try something different. In the 1840s Transcendentalists, believing the true path lay in the perfection of the individual, created intentional communities like Brook Farm . We've also seen socialist , anarchist , hippy , and virtually every other kind of Utopia in-between. Psychologist B.F. Skinner wrote an infamous book, Walden Two , with a more "scientific" take on creating a Utopian community and Ayn Rand in Atlas Shrugged had her free market version. I believe in startup organizations we see the modern version of Utopian energy in action. We now call it by names like "culture hacking", but the goal is the same: to create a new form of human community to achieve a profound go
6 0.87943649 402 high scalability-2008-10-05-Paper: Scalability Design Patterns
same-blog 8 0.86971831 300 high scalability-2008-04-07-Scalr - Open Source Auto-scaling Hosting on Amazon EC2
9 0.86338049 330 high scalability-2008-05-27-Should Twitter be an All-You-Can-Eat Buffet or a Vending Machine?
10 0.86163384 778 high scalability-2010-02-15-The Amazing Collective Compute Power of the Ambient Cloud
11 0.83840919 1414 high scalability-2013-03-01-Stuff The Internet Says On Scalability For February 29, 2013
12 0.83469784 848 high scalability-2010-06-25-Hot Scalability Links for June 25, 2010
13 0.81851906 1471 high scalability-2013-06-06-Paper: Memory Barriers: a Hardware View for Software Hackers
15 0.79564542 768 high scalability-2010-02-01-What Will Kill the Cloud?
16 0.7918219 879 high scalability-2010-08-12-Think of Latency as a Pseudo-permanent Network Partition
17 0.77732182 757 high scalability-2010-01-04-11 Strategies to Rock Your Startup’s Scalability in 2010
18 0.75441599 1492 high scalability-2013-07-17-How do you create a 100th Monkey software development culture?
19 0.70114934 564 high scalability-2009-04-10-counting # of views, calculating most-least viewed
20 0.69797653 19 high scalability-2007-07-16-Paper: Replication Under Scalable Hashing