high_scalability high_scalability-2008 high_scalability-2008-260 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market y
sentIndex sentText sentNum sentScore
1 Here's my template for describing the architecture of a system. [sent-1, score-0.258]
2 The idea is to have people fill out this template and that then becomes the basis for a profile. [sent-2, score-0.371]
3 The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. [sent-5, score-0.527]
4 Getting to Know You * What is the name of your system and where can we find out more about it? [sent-9, score-0.206]
5 Try to give a feel for how much work your system does. [sent-17, score-0.394]
6 Talk about how your system works in as much detail as you feel comfortable with. [sent-30, score-0.492]
7 * What particular design/architecture/implementation challenges does your system have? [sent-31, score-0.397]
8 * How does your system evolve to meet new scaling challenges? [sent-33, score-0.291]
9 * Do you use any particularly cool technologies are algorithms? [sent-34, score-0.229]
10 * What do you do that is unique and different that people could best learn from? [sent-35, score-0.185]
11 * Do you have a particular management philosophy? [sent-46, score-0.154]
12 * Which languages do you use to develop your system? [sent-53, score-0.229]
13 * Do you collocate, use a grid service, use a hosting service, etc? [sent-61, score-0.458]
14 * Which distributed job management system do you use? [sent-76, score-0.283]
15 * If you use a dynamic language which instruction caching product to use? [sent-80, score-0.464]
16 * Which third party services do you use to help build your system? [sent-83, score-0.229]
17 * Are your data centers active/active, active/passive? [sent-99, score-0.182]
18 * How do you handle syncing between data centers and fail over and load balancing? [sent-100, score-0.474]
19 * How do you handle virus checking of email and uploads? [sent-107, score-0.395]
20 * How do you handle major changes in database schemas on upgrades? [sent-110, score-0.219]
wordName wordTfidf (topN-words)
[('template', 0.258), ('use', 0.229), ('handle', 0.219), ('system', 0.206), ('centers', 0.182), ('team', 0.144), ('architected', 0.143), ('setup', 0.13), ('upgrades', 0.126), ('challenges', 0.114), ('people', 0.113), ('jog', 0.113), ('realistically', 0.113), ('salepost', 0.113), ('skillets', 0.113), ('thefriends', 0.113), ('decide', 0.105), ('strategy', 0.104), ('much', 0.103), ('patterned', 0.101), ('financed', 0.101), ('detail', 0.098), ('admire', 0.097), ('collocate', 0.097), ('miscellaneous', 0.094), ('virus', 0.092), ('possess', 0.092), ('monthly', 0.087), ('succeeded', 0.087), ('many', 0.086), ('meet', 0.085), ('feel', 0.085), ('email', 0.084), ('product', 0.082), ('questions', 0.08), ('caching', 0.078), ('check', 0.078), ('churn', 0.078), ('management', 0.077), ('service', 0.077), ('particular', 0.077), ('memories', 0.076), ('balancing', 0.075), ('instruction', 0.075), ('frame', 0.074), ('continuity', 0.073), ('syncing', 0.073), ('implement', 0.073), ('unique', 0.072), ('simulate', 0.072)]
simIndex simValue blogId blogTitle
1 1.0000001 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market you
same-blog 2 1.0000001 260 high scalability-2008-02-25-Architecture Template Advice Needed
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market y
3 0.36259213 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
Introduction: Update: Jake in Does Django really scale better than Rails? thinks apps like FFS shouldn't need so much hardware to scale. In a short three months Friends for Sale (think Hot-or-Not with a market economy) grew to become a top 10 Facebook application handling 200 gorgeous requests per second and a stunning 300 million page views a month. They did all this using Ruby on Rails, two part time developers, a cluster of a dozen machines, and a fairly standard architecture. How did Friends for Sale scale to sell all those beautiful people? And how much do you think your friends are worth on the open market? Site: http://www.facebook.com/apps/application.php?id=7019261521 Information Sources Siqi Chen and Alexander Le, co-creators of Friends for Sale, answering my standard questionairre. Virality on Facebook The Platform Ruby on Rails CentOS 5 (64 bit) Capistrano - update and restart application servers. Memcached MySQL Nginx Starling - distrib
4 0.3490895 399 high scalability-2008-10-01-Joyent - Cloud Computing Built on Accelerators
Introduction: Kent Langley was kind enough to create a profile template for Joyent , Kent's new employer. Joyent is an infrastructure and development company that has put together a multi-site, multi-million dollar hosting setup for their own applications and for the use of others . Joyent competes with the likes of Amazon and GoGrid in the multi-player cloud computing game and hosts Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App . The template was originally created with web services in mind, not cloud providers, but I think it still works in an odd sort of way. Remember, anyone can fill out a profile template for their system and share their wonderfulness with the world. Getting to Know You What is the name of your system and where can we find out more about it? Joyent Accelerator Cloud Computing IaaS My name is Kent Langley, Sr. Director, Joyent, Inc. (www.productionscale.com) The Joyent website is located at www.joyent.com The scope of this exe
5 0.25824234 1501 high scalability-2013-08-13-In Memoriam: Lavabit Architecture - Creating a Scalable Email Service
Introduction: With Lavabit shutting down under murky circumstances , it seems fitting to repost an old (2009), yet still very good post by Ladar Levison on Lavabit's architecture. I don't know how much of this information is still current, but it should give you a general idea what Lavabit was all about. Getting to Know You What is the name of your system and where can we find out more about it? Note: these links are no longer valid... Lavabit http://lavabit.com http://lavabit.com/network.html http://lavabit.com/about.html What is your system for? Lavabit is a mid-sized email service provider. We currently have about 140,000 registered users with more than 260,000 email addresses. While most of our accounts belong to individual users, we also provide corporate email services to approximately 70 companies. Why did you decide to build this system? We built the system to compete against the other large free email providers, with an emphasis on serving the privacy c
6 0.16702701 96 high scalability-2007-09-18-Amazon Architecture
7 0.16196159 70 high scalability-2007-08-22-How many machines do you need to run your site?
8 0.1617887 920 high scalability-2010-10-15-Troubles with Sharding - What can we learn from the Foursquare Incident?
11 0.159637 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
12 0.15940067 160 high scalability-2007-11-19-Tailrank Architecture - Learn How to Track Memes Across the Entire Blogosphere
13 0.15523458 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
14 0.15269586 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
topicId topicWeight
[(0, 0.305), (1, 0.056), (2, -0.045), (3, -0.114), (4, 0.016), (5, -0.098), (6, -0.009), (7, -0.095), (8, -0.017), (9, 0.103), (10, -0.004), (11, 0.084), (12, -0.056), (13, 0.005), (14, 0.082), (15, 0.022), (16, 0.07), (17, 0.065), (18, -0.018), (19, 0.065), (20, -0.011), (21, -0.037), (22, 0.006), (23, -0.161), (24, -0.067), (25, -0.025), (26, 0.063), (27, 0.058), (28, -0.092), (29, 0.143), (30, -0.034), (31, 0.031), (32, 0.064), (33, 0.013), (34, -0.033), (35, -0.063), (36, 0.001), (37, 0.198), (38, 0.093), (39, 0.02), (40, 0.044), (41, 0.064), (42, 0.207), (43, 0.124), (44, -0.07), (45, -0.115), (46, -0.173), (47, -0.032), (48, 0.068), (49, 0.007)]
simIndex simValue blogId blogTitle
1 0.98086017 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market you
same-blog 2 0.98086017 260 high scalability-2008-02-25-Architecture Template Advice Needed
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market y
3 0.83159977 399 high scalability-2008-10-01-Joyent - Cloud Computing Built on Accelerators
Introduction: Kent Langley was kind enough to create a profile template for Joyent , Kent's new employer. Joyent is an infrastructure and development company that has put together a multi-site, multi-million dollar hosting setup for their own applications and for the use of others . Joyent competes with the likes of Amazon and GoGrid in the multi-player cloud computing game and hosts Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App . The template was originally created with web services in mind, not cloud providers, but I think it still works in an odd sort of way. Remember, anyone can fill out a profile template for their system and share their wonderfulness with the world. Getting to Know You What is the name of your system and where can we find out more about it? Joyent Accelerator Cloud Computing IaaS My name is Kent Langley, Sr. Director, Joyent, Inc. (www.productionscale.com) The Joyent website is located at www.joyent.com The scope of this exe
4 0.72827905 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
Introduction: Update: Jake in Does Django really scale better than Rails? thinks apps like FFS shouldn't need so much hardware to scale. In a short three months Friends for Sale (think Hot-or-Not with a market economy) grew to become a top 10 Facebook application handling 200 gorgeous requests per second and a stunning 300 million page views a month. They did all this using Ruby on Rails, two part time developers, a cluster of a dozen machines, and a fairly standard architecture. How did Friends for Sale scale to sell all those beautiful people? And how much do you think your friends are worth on the open market? Site: http://www.facebook.com/apps/application.php?id=7019261521 Information Sources Siqi Chen and Alexander Le, co-creators of Friends for Sale, answering my standard questionairre. Virality on Facebook The Platform Ruby on Rails CentOS 5 (64 bit) Capistrano - update and restart application servers. Memcached MySQL Nginx Starling - distrib
5 0.70602822 160 high scalability-2007-11-19-Tailrank Architecture - Learn How to Track Memes Across the Entire Blogosphere
Introduction: Ever feel like the blogosphere is 500 million channels with nothing on? Tailrank finds the internet's hottest channels by indexing over 24M weblogs and feeds per hour. That's 52TB of raw blog content (no, not sewage) a month and requires continuously processing 160Mbits of IO. How do they do that? This is an email interview with Kevin Burton, founder and CEO of Tailrank.com. Kevin was kind enough to take the time to explain how they scale to index the entire blogosphere. Sites Tailrank - We track the hottest news in the blogosphere! Spinn3r - A blog spider you can specialize with your own behavior instead of creating your own. Kevin Burton's Blog - his blog is an indexing mix of politics and technical talk. Both are always interesting. Platform MySQL Java Linux (Debian) Apache Squid PowerDNS DAS storage. Federated database. ServerBeach hosting. Job scheduling system for work distribution. Interview What is your system is f
6 0.7044794 1501 high scalability-2013-08-13-In Memoriam: Lavabit Architecture - Creating a Scalable Email Service
7 0.69997507 500 high scalability-2009-01-22-Heterogeneous vs. Homogeneous System Architectures
8 0.66354525 245 high scalability-2008-02-12-Product: rPath - Creating and Managing Virtual Appliances
9 0.65834755 221 high scalability-2008-01-24-Mailinator Architecture
10 0.65446705 21 high scalability-2007-07-23-GoogleTalk Architecture
11 0.64029276 1546 high scalability-2013-11-11-Ask HS: What is a good OLAP database choice with node.js?
12 0.63127059 731 high scalability-2009-10-28-Need for change in your IT infrastructure
13 0.63055092 1379 high scalability-2012-12-31-Designing for Resiliency will be so 2013
14 0.62917864 67 high scalability-2007-08-17-What is the best hosting option?
15 0.62834913 253 high scalability-2008-02-19-Building a email communication system
16 0.62834769 377 high scalability-2008-09-03-SMACKDOWN :: Who are the Open Source Content Management System (CMS) market leaders in 2008?
17 0.62609959 275 high scalability-2008-03-14-Problem: Mobbing the Least Used Resource Error
18 0.62247449 76 high scalability-2007-08-29-Skype Failed the Boot Scalability Test: Is P2P fundamentally flawed?
19 0.62007117 1070 high scalability-2011-06-29-Second Hand Seizure : A New Cause of Site Death
20 0.61727446 1062 high scalability-2011-06-15-101 Questions to Ask When Considering a NoSQL Database
topicId topicWeight
[(1, 0.253), (2, 0.197), (10, 0.033), (45, 0.074), (55, 0.058), (61, 0.115), (77, 0.013), (79, 0.116), (85, 0.055), (94, 0.021)]
simIndex simValue blogId blogTitle
1 0.96760428 1354 high scalability-2012-11-05-Are we seeing the renaissance of enterprises in the cloud?
Introduction: A series of recent surveys on the subject seems to indicate that this is indeed the case: Research conducted by HP found that the majority of businesses in the EMEA region are planning to move their mission-critical apps to the cloud. Of the 940 respondents, 80 percent revealed plans to move mission-critical apps at some point over the next two to five years. A more recent survey, by research firm MeriTalk and sponsored by VMware and EMC (NYSE: EMC ), showed that one-third of respondents say they plan to move some mission-critical applications to the cloud in the next year. Within two years, the IT managers said they will move 26 percent of their mission-critical apps to the cloud, and in five years, they expect 44 percent of their mission-critical apps to run in the cloud. The Challenge - How to Bring Hundreds of Enterprise Apps to the Cloud The reality is that cloud economics only start making sense when there are true workloads that utilize the cloud inf
same-blog 2 0.96189255 260 high scalability-2008-02-25-Architecture Template Advice Needed
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market y
3 0.96188825 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market you
4 0.95548844 70 high scalability-2007-08-22-How many machines do you need to run your site?
Introduction: Amazingly TechCrunch runs their website on one web server and one database server, according to the fascinating survey What the Web’s most popular sites are running on by Pingdom , a provider of uptime and response time monitoring. Early we learned PlentyOfFish catches and releases many millions of hits a day on just 1 web server and three database servers. Google runs a Dalek army full of servers. YouSendIt , a company making it easy to send and receive large files, has 24 web servers, 3 database servers, 170 storage servers, and a few miscellaneous servers. Vimeo , a video sharing company, has 100 servers for streaming video, 4 web servers, and 2 database servers. Meebo , an AJAX based instant messaging company, uses 40 servers to handle messaging, over 40 web servers, and 10 servers for forums, jabber, testing, and so on. FeedBurner , a news feed management company, has 70 web servers, 15 database servers, and 10 miscellaneous servers. Now
Introduction: How do you layer a programmable Internet of smart things on top of the web? That's the question addressed by Dominique Guinard  in his ambitious dissertation: A Web of Things Application Architecture - Integrating the Real-World  ( slides ). With the continued siloing of content, perhaps we can keep our things open and talking to each other? In the architecture things are modeled using REST, they will be findable via search, they will be social via a social access controller, and they will be mashupable. Here's great graphical overview of the entire system:  Abstract: A central concern in the area of pervasive computing has been the integration of digital artifactsts with the physical world and vice-versa. Recent developments in the fi eld of embedded devices have led to smart things increasingly populating our daily life. We de fine smart things as digitally enhanced physical objectsts and devices that have communication capabilities. Application domains are for i
6 0.95305282 918 high scalability-2010-10-12-The CIO’s Problem: Cloud “Mess” or Cloud “Mash”
7 0.95180893 1093 high scalability-2011-08-05-Stuff The Internet Says On Scalability For August 5, 2011
8 0.95077372 509 high scalability-2009-02-05-Product: HAProxy - The Reliable, High Performance TCP-HTTP Load Balancer
9 0.95049059 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
10 0.95003885 1557 high scalability-2013-12-02-Evolution of Bazaarvoice’s Architecture to 500M Unique Users Per Month
11 0.94953561 840 high scalability-2010-06-10-The Four Meta Secrets of Scaling at Facebook
12 0.94912595 623 high scalability-2009-06-10-Dealing with multi-partition transactions in a distributed KV solution
13 0.94835579 688 high scalability-2009-08-26-Hot Links for 2009-8-26
14 0.9482947 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
15 0.94772893 707 high scalability-2009-09-17-Hot Links for 2009-9-17
16 0.94713318 1040 high scalability-2011-05-13-Stuff The Internet Says On Scalability For May 13, 2011
17 0.94647777 1309 high scalability-2012-08-22-Cloud Deployment: It’s All About Cloud Automation
18 0.94618392 1 high scalability-2007-07-06-Start Here
19 0.94598037 395 high scalability-2008-09-25-Is your cloud as scalable as you think it is?
20 0.94597244 126 high scalability-2007-10-20-Should you build your next website using 3tera's grid OS?