high_scalability high_scalability-2008 high_scalability-2008-289 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Amazon is fixing two of their major problems: no static IP addresses and single datacenter operation. By adding these two new features developers can finally build a no apology system on Amazon. Before you always had to throw in an apology or two. No, we don't have low failover times because of the silly DNS games and unexceptionable DNS update and propagation times and no, we don't operate in more than one datacenter. No more. Now Amazon is adding Elastic IP Addresses and Availability Zones . Elastic IP addresses are far better than normal IP addresses because they are both in tight with Jessica Alba and they are: Static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it. Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or availability zone failures by programmatica
sentIndex sentText sentNum sentScore
1 Amazon is fixing two of their major problems: no static IP addresses and single datacenter operation. [sent-1, score-0.58]
2 By adding these two new features developers can finally build a no apology system on Amazon. [sent-2, score-0.138]
3 Elastic IP addresses are far better than normal IP addresses because they are both in tight with Jessica Alba and they are: Static IP addresses designed for dynamic cloud computing. [sent-7, score-0.9]
4 An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it. [sent-8, score-0.195]
5 Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or availability zone failures by programmatically remapping your public IP addresses to any instance associated with your account. [sent-9, score-1.663]
6 Rather than waiting on a data technician to reconfigure or replace your host, or waiting for DNS to propagate to all of your customers, Amazon EC2 enables you to engineer around problems with your instance or software by programmatically remapping your Elastic IP address to a replacement instance. [sent-10, score-0.643]
7 They are giving us dynamically remappable IP addresses that fit well into the overall cloud computing paradigm that we can use to manage servers better than with traditional hosting solutions. [sent-13, score-0.403]
8 Cached static IP addresses will always be valid, which simplifies and speeds things up considerably, especially when using redundant load balancers as the entry point into your system. [sent-19, score-0.558]
9 The other power feature added was the ability to specify which datacenter your instances run in. [sent-20, score-0.144]
10 Amazon EC2 locations are composed of regions and availability zones. [sent-22, score-0.4]
11 Regions are geographically dispersed and will be in separate geographic areas or countries. [sent-23, score-0.184]
12 Availability zones are distinct locations that are engineered to be insulated from failures in other availability zones and provide inexpensive, low latency network connectivity to other availability zones in the same region. [sent-25, score-1.645]
13 By launching instances in separate availability zones, you can protect your applications from failure of a single location. [sent-27, score-0.252]
14 They are said to be: "inexpensive, low latency network connectivity to other availability zones in the same region. [sent-29, score-0.621]
15 I've been surprised before how fast datacenter links can be in that you didn't have code specially for these configurations. [sent-31, score-0.14]
16 And how system design will need to change once datacenters are in different regions of the world is another interesting question. [sent-33, score-0.233]
17 Other services still have more datacenters, more geographically dispersed datacenters than Amazon, and better content migration capabilities, but this is a great first step that allows developers to add another layer of reliability to their systems. [sent-34, score-0.272]
18 Update: I thought this was a good explanation of using static IPs in Some more about EC2 : Slashdot hasn't run many stories on EC2 (none that I know of) because until now it's been a niche service. [sent-35, score-0.26]
19 Without a way to guarantee that you can have a static IP, there had been a single point of failure: if your outward-facing VMs all went down, your only recourse was to start up more VMs on new, dynamically-assigned IPs, point your DNS to them, and wait hours for your users' DNS caches to expire. [sent-36, score-0.367]
20 Now with static IPs, you basically set up your service to have several VMs which provide the outward-facing service (maybe running a webserver, or a reverse proxy for your internal webservers), and you point your public, static IPs at those. [sent-38, score-0.511]
wordName wordTfidf (topN-words)
[('ip', 0.441), ('ips', 0.307), ('addresses', 0.3), ('zones', 0.3), ('static', 0.202), ('availability', 0.186), ('vms', 0.156), ('dns', 0.149), ('regions', 0.145), ('apology', 0.138), ('amazon', 0.134), ('remapping', 0.124), ('programmatically', 0.119), ('elastic', 0.119), ('dispersed', 0.109), ('instance', 0.103), ('rightscale', 0.093), ('inexpensive', 0.089), ('datacenters', 0.088), ('connectivity', 0.081), ('datacenter', 0.078), ('geographically', 0.075), ('locations', 0.069), ('eip', 0.069), ('instances', 0.066), ('associated', 0.065), ('insulated', 0.065), ('address', 0.065), ('waiting', 0.063), ('specially', 0.062), ('speedy', 0.062), ('explanation', 0.058), ('consist', 0.058), ('slashdot', 0.056), ('unacceptable', 0.056), ('mask', 0.056), ('point', 0.056), ('reconfigure', 0.055), ('low', 0.054), ('failures', 0.053), ('wait', 0.053), ('considerably', 0.052), ('hosting', 0.052), ('public', 0.052), ('ttl', 0.051), ('provide', 0.051), ('webserver', 0.051), ('assigning', 0.051), ('propagate', 0.051), ('fit', 0.051)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
Introduction: Amazon is fixing two of their major problems: no static IP addresses and single datacenter operation. By adding these two new features developers can finally build a no apology system on Amazon. Before you always had to throw in an apology or two. No, we don't have low failover times because of the silly DNS games and unexceptionable DNS update and propagation times and no, we don't operate in more than one datacenter. No more. Now Amazon is adding Elastic IP Addresses and Availability Zones . Elastic IP addresses are far better than normal IP addresses because they are both in tight with Jessica Alba and they are: Static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it. Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or availability zone failures by programmatica
2 0.37850624 168 high scalability-2007-11-30-Strategy: Efficiently Geo-referencing IPs
Introduction: A lot of apps need to map IP addresses to locations. Jeremy Cole in On efficiently geo-referencing IPs with MaxMind GeoIP and MySQL GIS succinctly explains the many uses for such a feature: Geo-referencing IPs is, in a nutshell, converting an IP address, perhaps from an incoming web visitor, a log file, a data file, or some other place, into the name of some entity owning that IP address. There are a lot of reasons you may want to geo-reference IP addresses to country, city, etc., such as in simple ad targeting systems, geographic load balancing, web analytics, and many more applications. This is difficult to do efficiently, at least it gives me a bit of brain freeze. In the same post Jeremy nicely explains where to get the geo-rereferncing data, how to load data, and the performance of different approaches for IP address searching. It's a great practical introduction to the subject.
3 0.20378777 290 high scalability-2008-03-28-How to Get DNS Names of a Web Server
Introduction: For some special reason, I'm trying to make a web server able to get all the DNS names mapped to its IP. Let me explain more, I'm creating a website that will run in a web farm, every web server in the farm will have some subdomains mapped to its ip, what I want is that whenever my application starts on a web server is to be able to get all the subdomains mapped/assigned to that server, e.g. sub1.mydomain.com, sub2.mydomain.com. I understand that I have to use reverse dns lookup (i.e. give the IP get the domain name), but I also want to get all the subdomains not just the first one that maps to that IP. I've been reading about DNS on the internet but I don't seem to find any information on how to achieve what I want, normally you use dns to get the ip of a domain but I'm not sure that all servers enable reverse lookup. The problem is that I'm still not sure whether I'll host my own DNS server or use the services of some company (many companies offer DNS hosting services), so, my qu
4 0.1679365 798 high scalability-2010-03-22-7 Secrets to Successfully Scaling with Scalr (on Amazon) by Sebastian Stadil
Introduction: This is a part interview part guest with Sebastian Stadil, founder of Scalr , a cheaper open-source version of RightScale. Scalr takes care of all the web site infrastructure bits to on Amazon (and other clouds) so you don’t have to. I first met Sebastian at one of the original Silicon Valley Cloud Computing Group meetups, a group which he founded. The meetings started in the tiny offices of Intalio where Sebastian was working with this new fangled Amazon thing to create an auto-scaling server farm on EC2. I remember distinctly how Sebastian met everyone at the door with a handshake and a smile, making us all feel welcome. Later I took one of the classes he created on how to use AWS. I guess he figured all this cloud stuff was going somewhere and decided to start Scalr. My only regret about this post is that the name Amazon does not begin with the letter ‘S’, that would have made for an epic title. Getting to Know You In this section are the responses Sebastian gave to a few
Introduction: When EC2 first started the mental model was of a magic Pez dispenser supplying an infinite stream of instances in any desired flavor. If you needed an instance, because of a either a failure or traffic spike, it would be there. As amazing as EC2 is, this model turned out to be optimistic. From a thread on the Amazon discussion forum we learn any dispenser has limits: As Availability Zones grow over time, our ability to continue to expand them can become constrained. In these scenarios, we will prevent customers from launching in the constrained zone if they do not yet have existing resources in that zone. We also might remove the constrained zone entirely from the list of options for new customers. This means that occasionally, different customers will see a different number of Availability Zones in a particular Region. Both approaches aim to help customers avoid accidentally starting to build up their infrastructure in an Availability Zone where they might have less ability
7 0.15641856 1102 high scalability-2011-08-22-Strategy: Run a Scalable, Available, and Cheap Static Site on S3 or GitHub
8 0.15624461 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
10 0.14634924 773 high scalability-2010-02-06-GEO-aware traffic load balancing and caching at CNBC.com
11 0.14018446 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
12 0.13876507 138 high scalability-2007-10-30-Feedblendr Architecture - Using EC2 to Scale
14 0.13426214 195 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half
15 0.13344097 1331 high scalability-2012-10-02-An Epic TripAdvisor Update: Why Not Run on the Cloud? The Grand Experiment.
16 0.13090299 907 high scalability-2010-09-23-Working With Large Data Sets
17 0.13078766 645 high scalability-2009-06-30-Hot New Trend: Linking Clouds Through Cheap IP VPNs Instead of Private Lines
18 0.12403383 1585 high scalability-2014-01-24-Stuff The Internet Says On Scalability For January 24th, 2014
19 0.12226435 266 high scalability-2008-03-04-Manage Downtime Risk by Connecting Multiple Data Centers into a Secure Virtual LAN
20 0.12071802 1275 high scalability-2012-07-02-C is for Compute - Google Compute Engine (GCE)
topicId topicWeight
[(0, 0.163), (1, 0.078), (2, -0.009), (3, 0.009), (4, -0.098), (5, -0.108), (6, 0.054), (7, -0.143), (8, 0.023), (9, -0.072), (10, -0.011), (11, -0.045), (12, 0.003), (13, -0.076), (14, 0.021), (15, 0.014), (16, 0.054), (17, 0.03), (18, 0.017), (19, -0.029), (20, 0.01), (21, 0.088), (22, -0.024), (23, -0.002), (24, -0.01), (25, 0.032), (26, -0.015), (27, 0.008), (28, -0.006), (29, -0.041), (30, -0.028), (31, -0.031), (32, -0.032), (33, 0.007), (34, 0.042), (35, -0.02), (36, -0.002), (37, 0.1), (38, -0.053), (39, 0.06), (40, -0.002), (41, 0.056), (42, 0.011), (43, -0.027), (44, 0.027), (45, 0.139), (46, 0.029), (47, -0.035), (48, 0.018), (49, -0.024)]
simIndex simValue blogId blogTitle
same-blog 1 0.97474337 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
Introduction: Amazon is fixing two of their major problems: no static IP addresses and single datacenter operation. By adding these two new features developers can finally build a no apology system on Amazon. Before you always had to throw in an apology or two. No, we don't have low failover times because of the silly DNS games and unexceptionable DNS update and propagation times and no, we don't operate in more than one datacenter. No more. Now Amazon is adding Elastic IP Addresses and Availability Zones . Elastic IP addresses are far better than normal IP addresses because they are both in tight with Jessica Alba and they are: Static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it. Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or availability zone failures by programmatica
2 0.69912022 138 high scalability-2007-10-30-Feedblendr Architecture - Using EC2 to Scale
Introduction: A man had a dream. His dream was to blend a bunch of RSS/Atom/RDF feeds into a single feed. The man is Beau Lebens of Feedville and like most dreamers he was a little short on coin. So he took refuge in the home of a cheap hosting provider and Beau realized his dream, creating FEEDblendr . But FEEDblendr chewed up so much CPU creating blended feeds that the cheap hosting provider ordered Beau to find another home. Where was Beau to go? He eventually found a new home in the virtual machine room of Amazon's EC2. This is the story of how Beau was finally able to create his one feeds safe within the cradle of affordable CPU cycles. Site: http://feedblendr.com/ The Platform EC2 (Fedora Core 6 Lite distro) S3 Apache PHP MySQL DynDNS (for round robin DNS) The Stats Beau is a developer with some sysadmin skills, not a web server admin, so a lot of learning was involved in creating FEEDblendr. FEEDblendr uses 2 EC2 instances. The same Amazon Instance (AMI) is
3 0.67188662 300 high scalability-2008-04-07-Scalr - Open Source Auto-scaling Hosting on Amazon EC2
Introduction: Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2. It has been recently open sourced on Google Code. Scalr allows you to create server farms through a web-based interface using prebuilt AMI's for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of. Scalr promises automatic high-availability and scaling for developers by health and load monitoring. The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it. 4 AMI's are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle t
4 0.65173292 1557 high scalability-2013-12-02-Evolution of Bazaarvoice’s Architecture to 500M Unique Users Per Month
Introduction: This is a guest post written by Victor Trac , Cloud Architect at Bazaarvoice . Bazaarvoice is a company that people interact with on a regular basis but have probably never heard of. If you read customer reviews on sites like bestbuy.com, nike.com, or walmart.com, you are using Bazaarvoice services. These sites, along with thousands of others, rely on Bazaarvoice to supply the software and technology to collect and display user conversations about products and services. All of this means that Bazaarvoice processes a lot of sentiment data on most of the products we all use daily. Bazaarvoice helps our clients make better products by using a combination of machine learning and natural language processing to extract useful information and user sentiments from the millions of free-text reviews that go through our platform. This data gets boiled down into reports that clients can use to improve their products and services. We are also starting to look at how to show per
5 0.64948326 798 high scalability-2010-03-22-7 Secrets to Successfully Scaling with Scalr (on Amazon) by Sebastian Stadil
Introduction: This is a part interview part guest with Sebastian Stadil, founder of Scalr , a cheaper open-source version of RightScale. Scalr takes care of all the web site infrastructure bits to on Amazon (and other clouds) so you don’t have to. I first met Sebastian at one of the original Silicon Valley Cloud Computing Group meetups, a group which he founded. The meetings started in the tiny offices of Intalio where Sebastian was working with this new fangled Amazon thing to create an auto-scaling server farm on EC2. I remember distinctly how Sebastian met everyone at the door with a handshake and a smile, making us all feel welcome. Later I took one of the classes he created on how to use AWS. I guess he figured all this cloud stuff was going somewhere and decided to start Scalr. My only regret about this post is that the name Amazon does not begin with the letter ‘S’, that would have made for an epic title. Getting to Know You In this section are the responses Sebastian gave to a few
6 0.63506788 824 high scalability-2010-05-06-Going global on EC2
7 0.63139075 477 high scalability-2008-12-29-100% on Amazon Web Services: Soocial.com - a lesson of porting your service to Amazon
9 0.62120384 290 high scalability-2008-03-28-How to Get DNS Names of a Web Server
10 0.62092483 1296 high scalability-2012-08-02-Strategy: Use Spare Region Capacity to Survive Availability Zone Failures
11 0.61710203 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
12 0.61236924 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
13 0.60673374 1392 high scalability-2013-01-23-Building Redundant Datacenter Networks is Not For Sissies - Use an Outside WAN Backbone
14 0.60652852 1331 high scalability-2012-10-02-An Epic TripAdvisor Update: Why Not Run on the Cloud? The Grand Experiment.
15 0.60619462 773 high scalability-2010-02-06-GEO-aware traffic load balancing and caching at CNBC.com
16 0.60555959 249 high scalability-2008-02-16-S3 Failed Because of Authentication Overload
17 0.60262626 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
18 0.59271801 168 high scalability-2007-11-30-Strategy: Efficiently Geo-referencing IPs
19 0.59224248 1543 high scalability-2013-11-05-10 Things You Should Know About AWS
20 0.59156573 195 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half
topicId topicWeight
[(1, 0.119), (2, 0.198), (10, 0.075), (17, 0.014), (27, 0.014), (30, 0.014), (47, 0.012), (61, 0.072), (64, 0.073), (79, 0.175), (85, 0.041), (94, 0.088)]
simIndex simValue blogId blogTitle
same-blog 1 0.97552609 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
Introduction: Amazon is fixing two of their major problems: no static IP addresses and single datacenter operation. By adding these two new features developers can finally build a no apology system on Amazon. Before you always had to throw in an apology or two. No, we don't have low failover times because of the silly DNS games and unexceptionable DNS update and propagation times and no, we don't operate in more than one datacenter. No more. Now Amazon is adding Elastic IP Addresses and Availability Zones . Elastic IP addresses are far better than normal IP addresses because they are both in tight with Jessica Alba and they are: Static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it. Unlike traditional static IP addresses, however, Elastic IP addresses allow you to mask instance or availability zone failures by programmatica
2 0.95886135 914 high scalability-2010-10-04-Paper: An Analysis of Linux Scalability to Many Cores
Introduction: An Analysis of Linux Scalability to Many Cores , by a number of MIT researchers, is a refreshingly practical paper on what it takes to scale Linux and common applications like Exim, memcached, Apache, PostgreSQL, gmake, Psearchy, and MapReduce to run on 48 core systems. A very timely paper given moderately massive multicore systems are reportedly the near future of computing. This paper must have taken a lot of work. They both tracked down bottlenecks in a number of applications and the Linux kernel and they also tried to fix them. Modestly speaking the authors said they made "modest" changes to the kernel and applications, but there's nothing modest about what they did. It's excellent work. After the next bit, which is the abstract, there is a list of the problems they found and how they fixed them. The abstract: This paper analyzes the scalability of seven system applications (Exim, memcached, Apache, PostgreSQL, gmake, Psearchy, and MapReduce) running on Linux on a 48-core
3 0.95617557 716 high scalability-2009-10-06-Building a Unique Data Warehouse
Introduction: There are many reasons to roll your own data storage solution on top of existing technologies. We've seen stories on HighScalability about custom databases for very large sets of individual data (like Twitter) and large amounts of binary data (like Facebook pictures). However, I recently ran into a unique type of problem. I was tasked with recording and storing bandwidth information for more than 20,000 servers and their associated networking equipment. This data needed to be accessed in real-time, with less than a 5 minute delay between the data being recorded and the data showing up on customer bandwidth graphs on our customer portal. After numerous false starts with off the shelf components and existing database clustering technology, we decided we must roll our own system. The real key to our problem (literally) was the ratio of the size of the key to the size of the actual data . Because the tracked metric was so small (a 64-bit counter) compared to the unique ide
4 0.94958854 1316 high scalability-2012-09-04-Changing Architectures: New Datacenter Networks Will Set Your Code and Data Free
Introduction: One consequence of IT standardization and commodification has been Google’s datacenter is the computer view of the world. In that view all compute resources (memory, CPU, storage) are fungible. They are interchangeable and location independent, individual computers lose identity and become just a part of a service. Thwarting that nirvana has been the abysmal performance of commodity datacenter networks which have caused the preference of architectures that favor the collocation of state and behaviour on the same box. MapReduce famously ships code over to storage nodes for just this reason. Change the network and you change the fundamental assumption driving collocation based software architectures. You are then free to store data anywhere and move compute anywhere you wish. The datacenter becomes the computer. On the host side with an x8 slot running at PCI-Express 3.0 speeds able to push 8GB/sec (that’s bytes) of bandwidth in both directions, we have
5 0.94714671 1612 high scalability-2014-03-14-Stuff The Internet Says On Scalability For March 14th, 2014
Introduction: Hey, it's HighScalability time: LifeExplorer Cells in 3D Quotable Quotes: The Master Switch : History shows a typical progression of information technologies: from somebody’s hobby to somebody’s industry; from jury-rigged contraption to slick production marvel; from a freely accessible channel to one strictly controlled by a single corporation or cartel—from open to closed system. @adrianco : #qconlondon @russmiles on PaaS "As old as I am, a leaky abstraction would be awful..." @Obdurodon : "Scaling is hard. Let's make excuses." @TomRoyce : @jeffjarvis the rot is deep... The New Jersey pols just used Tesla to shake down the car dealers. @CompSciFact : "The cheapest, fastest and most reliable components of a computer system are those that aren't there." -- Gordon Bell @glyph : “Eventually consistent” is just another way to say “not consistent right now”. @nutshell : LinkedIn is shutting down access to their APIs
6 0.94439626 1649 high scalability-2014-05-16-Stuff The Internet Says On Scalability For May 16th, 2014
8 0.94361347 1476 high scalability-2013-06-14-Stuff The Internet Says On Scalability For June 14, 2013
9 0.94334114 763 high scalability-2010-01-22-How BuddyPoke Scales on Facebook Using Google App Engine
10 0.94239086 1630 high scalability-2014-04-11-Stuff The Internet Says On Scalability For April 11th, 2014
11 0.94157553 517 high scalability-2009-02-21-Google AppEngine - A Second Look
12 0.94069111 789 high scalability-2010-03-05-Strategy: Planning for a Power Outage Google Style
13 0.94010717 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
15 0.94003469 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
16 0.93958896 1186 high scalability-2012-02-02-The Data-Scope Project - 6PB storage, 500GBytes-sec sequential IO, 20M IOPS, 130TFlops
17 0.93915945 129 high scalability-2007-10-23-Hire Facebook, Ning, and Salesforce to Scale for You
18 0.93883491 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
19 0.93843693 1275 high scalability-2012-07-02-C is for Compute - Google Compute Engine (GCE)
20 0.93758976 1647 high scalability-2014-05-14-Google Says Cloud Prices Will Follow Moore’s Law: Are We All Renters Now?