high_scalability high_scalability-2008 high_scalability-2008-399 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Kent Langley was kind enough to create a profile template for Joyent , Kent's new employer. Joyent is an infrastructure and development company that has put together a multi-site, multi-million dollar hosting setup for their own applications and for the use of others . Joyent competes with the likes of Amazon and GoGrid in the multi-player cloud computing game and hosts Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App . The template was originally created with web services in mind, not cloud providers, but I think it still works in an odd sort of way. Remember, anyone can fill out a profile template for their system and share their wonderfulness with the world. Getting to Know You What is the name of your system and where can we find out more about it? Joyent Accelerator Cloud Computing IaaS My name is Kent Langley, Sr. Director, Joyent, Inc. (www.productionscale.com) The Joyent website is located at www.joyent.com The scope of this exe
sentIndex sentText sentNum sentScore
1 Joyent is an infrastructure and development company that has put together a multi-site, multi-million dollar hosting setup for their own applications and for the use of others . [sent-2, score-0.308]
2 Joyent competes with the likes of Amazon and GoGrid in the multi-player cloud computing game and hosts Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App . [sent-3, score-0.171]
3 It is essentially a system that provides infrastructure primitives as a service (IaaS) for building cloud computing applications, migrating enterprise data center operations to secure private clouds, or just hosting your blog. [sent-17, score-0.512]
4 Billions and Billions (multiple billion+ page view per month clients) What is your in/out bandwidth usage? [sent-50, score-0.203]
5 Talk about how your system works in as much detail as you feel comfortable with. [sent-69, score-0.219]
6 BigIP F5 Application Switches Force 10 (1GB and 10GB switching) Custom Dell Hardware with some secret sauce Tier1 Hosting Providers Essentially a custom Solaris Nevada based OS Core w/ a Pkgsrc install system What particular design/architecture/implementation challenges does your system have? [sent-73, score-0.275]
7 A recent example is when a client needed a private cloud computing environment to achieve PCI compliance in a cloud environment. [sent-84, score-0.425]
8 While it is in production for two clients already we consider this a beta product. [sent-86, score-0.242]
9 This is an example of a way we have evolved our systems to respond to the changing cloud computing market place. [sent-88, score-0.171]
10 ZFS, BigIP, DTrace, OpenSolaris Nevada, and an in-house custom provisioning system we call MCP (hat's off to Tron) What do you do that is unique and different that people could best learn from? [sent-90, score-0.256]
11 We have a custom cloud provisioning system called MCP. [sent-128, score-0.345]
12 Well, our clients often use Nginx and now that there is a viable port of Varnish to OpenSolaris we are seeing more of that. [sent-137, score-0.348]
13 Do you collocate, use a grid service, use a hosting service, etc? [sent-140, score-0.287]
14 Our clients do this depending on their development platform of choice at the application layer. [sent-156, score-0.242]
15 Also, we can of course use our BigIP load balancing infrastructure to help out with that also. [sent-157, score-0.223]
16 We have clients that use just about everything you can think of. [sent-173, score-0.348]
17 Our clients often co-locate in multiple locations so that they can have solid DR scenarios to keep investors happen and recover quickly should a truck hit a telephone pole or something. [sent-199, score-0.242]
18 High level snap shots, clients are responsible for their own data primarily. [sent-208, score-0.242]
19 This is up to the clients and highly platform and applications specific. [sent-215, score-0.242]
20 In essence pay for what you need when you need it on a month to month granularity. [sent-231, score-0.182]
wordName wordTfidf (topN-words)
[('joyent', 0.438), ('clients', 0.242), ('accelerators', 0.223), ('accelerator', 0.174), ('kent', 0.158), ('bigip', 0.14), ('gib', 0.14), ('aprofile', 0.11), ('nevada', 0.11), ('use', 0.106), ('client', 0.102), ('system', 0.101), ('month', 0.091), ('cloud', 0.089), ('opensolaris', 0.089), ('provisioning', 0.082), ('computing', 0.082), ('hoffman', 0.081), ('centers', 0.081), ('try', 0.079), ('sun', 0.078), ('langley', 0.077), ('setup', 0.076), ('team', 0.076), ('handle', 0.075), ('hosting', 0.075), ('custom', 0.073), ('solaris', 0.073), ('employee', 0.073), ('jason', 0.071), ('billions', 0.066), ('balancing', 0.066), ('architected', 0.063), ('private', 0.063), ('significant', 0.062), ('exceptionally', 0.062), ('much', 0.061), ('scope', 0.06), ('per', 0.059), ('recommend', 0.059), ('postgres', 0.059), ('works', 0.057), ('many', 0.057), ('email', 0.056), ('upgrades', 0.055), ('follows', 0.054), ('page', 0.053), ('erlang', 0.051), ('service', 0.051), ('infrastructure', 0.051)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999982 399 high scalability-2008-10-01-Joyent - Cloud Computing Built on Accelerators
Introduction: Kent Langley was kind enough to create a profile template for Joyent , Kent's new employer. Joyent is an infrastructure and development company that has put together a multi-site, multi-million dollar hosting setup for their own applications and for the use of others . Joyent competes with the likes of Amazon and GoGrid in the multi-player cloud computing game and hosts Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App . The template was originally created with web services in mind, not cloud providers, but I think it still works in an odd sort of way. Remember, anyone can fill out a profile template for their system and share their wonderfulness with the world. Getting to Know You What is the name of your system and where can we find out more about it? Joyent Accelerator Cloud Computing IaaS My name is Kent Langley, Sr. Director, Joyent, Inc. (www.productionscale.com) The Joyent website is located at www.joyent.com The scope of this exe
2 0.3490895 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market you
3 0.3490895 260 high scalability-2008-02-25-Architecture Template Advice Needed
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market y
4 0.32451057 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
Introduction: Several months ago I attended a Joyent presentation where the spokesman hinted that Joyent had the chops to support a one billion page per month Facebook Ruby on Rails application. Even under a few seconds of merciless grilling he would not give up the name of the application. Now we have the big reveal: it was LinkedIn's Bumper Sticker app. For those not currently sticking things on bumps, Bumper Sticker is quite surprisingly a viral media sharing application that allows users to express their individuality by sticking small virtual stickers on Facebook profiles . At the time I was quite curious how Joyent's cloud approach could be leveraged for this kind of app. Now that they've released a few details, we get to find out. Site: http://www.Facebook.com/apps/application.php?id=2427603417 Information Sources Video: Scaling to 1 Billion Page Views Per MonthVideo (very flashy) Web Scalability Practices: Bumper Sticker on Rails by Ikai Lan and Jim Meyer from LinkedIn 1
5 0.22749804 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
Introduction: Update: Jake in Does Django really scale better than Rails? thinks apps like FFS shouldn't need so much hardware to scale. In a short three months Friends for Sale (think Hot-or-Not with a market economy) grew to become a top 10 Facebook application handling 200 gorgeous requests per second and a stunning 300 million page views a month. They did all this using Ruby on Rails, two part time developers, a cluster of a dozen machines, and a fairly standard architecture. How did Friends for Sale scale to sell all those beautiful people? And how much do you think your friends are worth on the open market? Site: http://www.facebook.com/apps/application.php?id=7019261521 Information Sources Siqi Chen and Alexander Le, co-creators of Friends for Sale, answering my standard questionairre. Virality on Facebook The Platform Ruby on Rails CentOS 5 (64 bit) Capistrano - update and restart application servers. Memcached MySQL Nginx Starling - distrib
6 0.20085436 1501 high scalability-2013-08-13-In Memoriam: Lavabit Architecture - Creating a Scalable Email Service
7 0.19651458 503 high scalability-2009-01-27-Video: Storage in the Cloud at Joyent
8 0.18825479 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
10 0.16574359 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
14 0.15881087 905 high scalability-2010-09-21-Sponsored Post: Joyent, DeviantART, CloudSigma, ManageEngine, Site24x7
17 0.15682006 909 high scalability-2010-09-28-Sponsored Post: Wiredrive, Joyent, DeviantART, CloudSigma, ManageEngine, Site24x7
topicId topicWeight
[(0, 0.316), (1, 0.038), (2, 0.06), (3, -0.053), (4, -0.025), (5, -0.119), (6, 0.002), (7, -0.147), (8, -0.026), (9, 0.075), (10, 0.016), (11, 0.056), (12, 0.032), (13, 0.055), (14, 0.004), (15, 0.012), (16, 0.022), (17, 0.021), (18, -0.022), (19, 0.017), (20, 0.035), (21, -0.034), (22, 0.001), (23, -0.074), (24, 0.007), (25, 0.016), (26, 0.095), (27, 0.038), (28, -0.006), (29, 0.076), (30, -0.012), (31, -0.01), (32, -0.016), (33, 0.03), (34, 0.001), (35, 0.015), (36, 0.015), (37, 0.112), (38, -0.021), (39, -0.003), (40, -0.017), (41, 0.026), (42, 0.128), (43, 0.097), (44, -0.091), (45, -0.078), (46, -0.085), (47, -0.017), (48, 0.025), (49, -0.03)]
simIndex simValue blogId blogTitle
same-blog 1 0.97092503 399 high scalability-2008-10-01-Joyent - Cloud Computing Built on Accelerators
Introduction: Kent Langley was kind enough to create a profile template for Joyent , Kent's new employer. Joyent is an infrastructure and development company that has put together a multi-site, multi-million dollar hosting setup for their own applications and for the use of others . Joyent competes with the likes of Amazon and GoGrid in the multi-player cloud computing game and hosts Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App . The template was originally created with web services in mind, not cloud providers, but I think it still works in an odd sort of way. Remember, anyone can fill out a profile template for their system and share their wonderfulness with the world. Getting to Know You What is the name of your system and where can we find out more about it? Joyent Accelerator Cloud Computing IaaS My name is Kent Langley, Sr. Director, Joyent, Inc. (www.productionscale.com) The Joyent website is located at www.joyent.com The scope of this exe
2 0.82485372 259 high scalability-2008-02-25-Any Suggestions for the Architecture Template?
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market you
3 0.82485372 260 high scalability-2008-02-25-Architecture Template Advice Needed
Introduction: Here's my template for describing the architecture of a system. The idea is to have people fill out this template and that then becomes the basis for a profile. This is how the Friends for Sale post was created and I think that turned out well. People always want more detail, but realistically you can only expect so much. The template is definitely too long, but it's more just a series of questions to jog people's memories and then they can answer whatever they think is important. What I want to ask is if you can think of any things to add/delete/change in the template? What do you want to know about the systems people are building? So if you have the time, please take a look and tell me what you think. Getting to Know You * What is the name of your system and where can we find out more about it? * What is your system is for? * Why did you decide to build this system? * How is your project financed? * What is your revenue model? * How do you market y
4 0.77462035 160 high scalability-2007-11-19-Tailrank Architecture - Learn How to Track Memes Across the Entire Blogosphere
Introduction: Ever feel like the blogosphere is 500 million channels with nothing on? Tailrank finds the internet's hottest channels by indexing over 24M weblogs and feeds per hour. That's 52TB of raw blog content (no, not sewage) a month and requires continuously processing 160Mbits of IO. How do they do that? This is an email interview with Kevin Burton, founder and CEO of Tailrank.com. Kevin was kind enough to take the time to explain how they scale to index the entire blogosphere. Sites Tailrank - We track the hottest news in the blogosphere! Spinn3r - A blog spider you can specialize with your own behavior instead of creating your own. Kevin Burton's Blog - his blog is an indexing mix of politics and technical talk. Both are always interesting. Platform MySQL Java Linux (Debian) Apache Squid PowerDNS DAS storage. Federated database. ServerBeach hosting. Job scheduling system for work distribution. Interview What is your system is f
5 0.76109773 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
Introduction: Every system has a limit. Although most providers of web hosting services claim to provide "Unlimited", we all know that any web server has physical limits which is usually hard to scale up, especially without taking the machine offline. Most IT hosting companies use stand-alone servers to provide website hosting. A very few use any form of HA clusters. Those web hosts that use stand-alone servers do not feature scalability. Every time they need to upgrade the machines they use, major changes to the systems have to be made. Others which that do clustering are more scalable. They would add additional servers to their systems or to remove machines from the set-ups. There are many scenarios and different models of doing clustering. However I'm not the one who would write about them. Plus this is not the purpose of this article. The reason to start this article at High Scalability is to present Cloud.bg , a cloud hosting service delivered from a Linux based high availability and hig
6 0.75636065 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
7 0.73332751 245 high scalability-2008-02-12-Product: rPath - Creating and Managing Virtual Appliances
8 0.72374725 1501 high scalability-2013-08-13-In Memoriam: Lavabit Architecture - Creating a Scalable Email Service
9 0.71343678 663 high scalability-2009-07-28-37signals Architecture
10 0.69118947 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
11 0.69098932 880 high scalability-2010-08-13-Hot Scalability Links for Aug 13, 2010
13 0.68605894 540 high scalability-2009-03-16-Cisco and Sun to Compete for Unified Computing?
14 0.68263942 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
15 0.68188453 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
16 0.67362726 1573 high scalability-2014-01-06-How HipChat Stores and Indexes Billions of Messages Using ElasticSearch and Redis
17 0.67191887 21 high scalability-2007-07-23-GoogleTalk Architecture
18 0.66802233 740 high scalability-2009-11-11-Hot Scalability Links for Nov 11 2009
19 0.66786659 388 high scalability-2008-09-23-Event: CloudCamp Silicon Valley Unconference on 30th September
20 0.66619104 1077 high scalability-2011-07-11-ATMCash Exploits Virtualization for Security - Immutability and Reversion
topicId topicWeight
[(1, 0.188), (2, 0.188), (10, 0.046), (30, 0.021), (40, 0.017), (49, 0.153), (56, 0.014), (61, 0.078), (77, 0.022), (79, 0.108), (85, 0.039), (94, 0.038)]
simIndex simValue blogId blogTitle
1 0.96644342 737 high scalability-2009-11-05-A Yes for a NoSQL Taxonomy
Introduction: NorthScale's Steven Yen in his highly entertaining NoSQL is a Horseless Carriage presentation has come up with a NoSQL taxonomy that thankfully focuses a little more on what NoSQL is, than what it isn't : key‐value‐cache memcached, repcached, coherence, infinispan, eXtreme scale, jboss cache, velocity, terracoqa key‐value‐store keyspace, flare, schema‐free, RAMCloud eventually‐consistent key‐value‐store dynamo, voldemort, Dynomite, SubRecord, Mo8onDb, Dovetaildb ordered‐key‐value‐store tokyo tyrant, lightcloud, NMDB, luxio, memcachedb, actord data‐structures server redis tuple‐store gigaspaces, coord, apache river object database ZopeDB, db4o, Shoal document store CouchDB, Mongo, Jackrabbit, XML Databases, ThruDB, CloudKit, Perservere, Riak Basho, Scalaris wide columnar store BigTable, Hbase, Cassandra, Hypertable, KAI, OpenNeptune, Qbase, KDI "Who will win?"
2 0.96529603 400 high scalability-2008-10-01-The Pattern Bible for Distributed Computing
Introduction: Software design patterns are an emerging tool for guiding and documenting system design. Patterns usually describe software abstractions used by advanced designers and programmers in their software. Patterns can provide guidance for designing highly scalable distributed systems. Let's see how! Patterns are in essence solutions to problems. Most of them are expressed in a format called Alexandrian form which draws on constructs used by Christopher Alexander. There are variants but most look like this: The pattern name The problem the pattern is trying to solve Context Solution Examples Design rationale: This tells where the pattern came from, why it works, and why experts use it Patterns rarely stand alone. Each pattern works on a context, and transforms the system in that context to produce a new system in a new context. New problems arise in the new system and context, and the next ‘‘layer’’ of patterns can be applied. A pattern language is a structured col
3 0.95304137 321 high scalability-2008-05-17-WebSphere Commerce High Availability and Performance Configurations
Introduction: Nobody came up with an example of a website powered by a Websphere product (which has a community edition) and backed up by a DB2 database. I guess you all know about usopen.org so here's the story: While the re-emergence of 35-year-old Andre Agassi and the continued dominance of wunderkind Maria Sharapova have highlighted the on-court headlines at this year's U.S. Open Tennis Championships in Flushing Meadows, N.Y., IBM is hoping its new Power5 chip-based IT support for USOpen.org can make news among those more interested in .NET than tennis nets. Big Blue has partnered with the U.S. Tennis Association and the U.S. Open -- the most prestigious tennis tournament in the U.S. -- since 1992. Together, they launched USOpen.org in 1995 so racket heads could follow the matches online. The iSeries' role this year is in powering a Web-based end-user application called "Point Tracker," a graphics tool using autonomic technology that recreates the trajectory of every shot. On-c
4 0.93588215 1311 high scalability-2012-08-24-Stuff The Internet Says On Scalability For August 24, 2012
Introduction: It's HighScalability Time: 500 TB/day: Facebook data Quotable Quotes: Tumblr mobocracy : This is what migrating a billion cache objects into a new cache pool looks like #hoti it is possible to build all to all wdm networks where there is a wavelength per core. A Generation Lost in the Bazaar . The problem is Cathedrals are multi-generation projects, built by master craftsman, using an empirical process, not engineering principles. There is no complete specification, it's iterative and adaptive. How Bazaar. Here's a unique look at how the new Digg 4 structured their architecture and development processes to scale down to 14 engineers from a high of 40 engineers for the old Digg. As the team shrunk very few new unit tests were written and the system tests were dumped. Using Thrift between components helped coordinate the team. A dark rollout mechanism allowed them to rollout and test features on a subset of users. Development team used
Introduction: Michael Stonebraker sure knows how to stir up a storm. Unlike for others, that doesn't make him a troll in my mind, he's way too accomplished in the field to be that, but he does have a bit of Barnum & Bailey in him, which serves to get the discussion flowing, and that's a good thing. A lot of previously hidden wisdom and passion unlocks, which we'll try to capture here. This disturbance in the force is over OldSQL vs NoSQL vs NewSQL . Warning, these are not crisp categories, there's leakage all over the place, watch your step: OldSQL (Oracle, MySQL, etc) refers to what some want to term as legacy relational database like MySQL, that don't scale out horizontally with aplomb. NoSQL (CouchDB, Redis, Cassandra, HBase, MongoDB, Riak, Neo4j, etc) refers to, well, a collection of technologies that aren't OldSQL, these often are designed to scale out horizontally, aren't on ACID, and use schemaless non-relational datamodels. NewSQL (Xeround, Clustrix, NimbusDB, GenieDB, Sc
same-blog 6 0.92572862 399 high scalability-2008-10-01-Joyent - Cloud Computing Built on Accelerators
8 0.91580981 735 high scalability-2009-11-01-Squeeze more performance from Parallelism
9 0.9089182 1359 high scalability-2012-11-15-Gone Fishin': Justin.Tv's Live Video Broadcasting Architecture
10 0.90822107 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
11 0.90461302 1258 high scalability-2012-06-05-Thesis: Concurrent Programming for Scalable Web Architectures
12 0.89224195 823 high scalability-2010-05-05-How will memristors change everything?
13 0.89153171 35 high scalability-2007-07-28-Product: FastStats Log Analyzer
14 0.89143544 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
15 0.88976592 1537 high scalability-2013-10-25-Stuff The Internet Says On Scalability For October 25th, 2013
16 0.88930255 1093 high scalability-2011-08-05-Stuff The Internet Says On Scalability For August 5, 2011
17 0.88761932 1646 high scalability-2014-05-12-4 Architecture Issues When Scaling Web Applications: Bottlenecks, Database, CPU, IO
18 0.88688105 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
19 0.88610208 1011 high scalability-2011-03-25-Did the Microsoft Stack Kill MySpace?
20 0.88466477 1557 high scalability-2013-12-02-Evolution of Bazaarvoice’s Architecture to 500M Unique Users Per Month