high_scalability high_scalability-2007 high_scalability-2007-133 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Automattic recently purchase Gravatar and have switched the server onto their hosting platform. WordPress.com host over 1.7 million blogs with well over 60'000 new posts submitted each day generating 10 - 12 million page views per day. Barry on WordPress.com has a great post on the changes they've introduced to help Gravatar scale .
sentIndex sentText sentNum sentScore
1 Automattic recently purchase Gravatar and have switched the server onto their hosting platform. [sent-1, score-0.79]
2 7 million blogs with well over 60'000 new posts submitted each day generating 10 - 12 million page views per day. [sent-4, score-1.457]
3 com has a great post on the changes they've introduced to help Gravatar scale . [sent-6, score-0.475]
wordName wordTfidf (topN-words)
[('gravatar', 0.67), ('automattic', 0.315), ('agreat', 0.26), ('blogs', 0.202), ('introduced', 0.202), ('switched', 0.198), ('generating', 0.188), ('submitted', 0.187), ('onto', 0.165), ('posts', 0.146), ('million', 0.145), ('views', 0.133), ('purchase', 0.128), ('recently', 0.127), ('hosting', 0.127), ('host', 0.12), ('changes', 0.089), ('page', 0.089), ('day', 0.075), ('help', 0.07), ('post', 0.067), ('per', 0.057), ('well', 0.057), ('scale', 0.047), ('server', 0.045), ('new', 0.033)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999988 133 high scalability-2007-10-26-How Gravatar scales on WordPress.com hardware
Introduction: Automattic recently purchase Gravatar and have switched the server onto their hosting platform. WordPress.com host over 1.7 million blogs with well over 60'000 new posts submitted each day generating 10 - 12 million page views per day. Barry on WordPress.com has a great post on the changes they've introduced to help Gravatar scale .
2 0.24865443 1329 high scalability-2012-09-26-WordPress.com Serves 70,000 req-sec and over 15 Gbit-sec of Traffic using NGINX
Introduction: This is a guest post by Barry Abrahamson , Chief Systems Wrangler at Automattic, and Nginx's Coufounder Andrew Alexeev. WordPress.com serves more than 33 million sites attracting over 339 million people and 3.4 billion pages each month. Since April 2008, WordPress.com has experienced about 4.4 times growth in page views. WordPress.com VIP hosts many popular sites including CNN’s Political Ticker, NFL, Time Inc’s The Page, People Magazine’s Style Watch, corporate blogs for Flickr and KROQ, and many more. Automattic operates two thousand servers in twelve, globally distributed, data centers. WordPress.com customer data is instantly replicated between different locations to provide an extremely reliable and fast web experience for hundreds of millions of visitors. Problem WordPress.com, which began in 2005, started on shared hosting, much like all of the WordPress.org sites. It was soon moved to a single dedicated server and then to two servers. In late 2005, WordPress.com
3 0.10650495 692 high scalability-2009-09-01-Cheap storage: how backblaze takes matters in hand
Introduction: Blackblaze blogs about how they built their own storage infrastructure on the cheap to run their cloud backup service. This episode: the hardware. Sorry, just a link this time.
4 0.097084194 405 high scalability-2008-10-07-Help a Scoble out. What should Robert ask in his scalability interview?
Introduction: One of the cool things about Mr. Scoble is he doesn't pretend to know everything, which can be an deadly boring affliction in this field. In this case Robert is asking for help in an upcoming interview. Maybe we can help? Here's Robert's plight: I’m really freaked out. I have one of the biggest interviews of my life coming up and I’m way under qualified to host it. It’s on Thursday and it’s about Scalability and Performance of Web Services. Look at who will be on. Matt Mullenweg, founder of Automattic, the company behind WordPress (and behind this blog). Paul Bucheit, one of the founders of FriendFeed and the creator of Gmail (he’s also the guy who gave Google the “don’t be evil” admonishion). Nat Brown, CTO of iLike, which got six million users on Facebook in about 10 days. What would you ask?
5 0.089592166 408 high scalability-2008-10-10-Useful Corporate Blogs that Talk About Scalability
Introduction: Some intrepid company blogs are posting their technical challenges and how they solve them. I wish more would open up and talk about what they are doing as it helps everyone move forward. Here are a few blogs documenting their encounters with the bleeding edge: Flickr Digg LinkedIn Facebook Amazon Web Services blog Twitter blog Reddit blog Photobucket blog Second Life blog PlentyofFish blog Joyent's Blog Any others that should be added?
6 0.07953614 638 high scalability-2009-06-26-PlentyOfFish Architecture
7 0.078779556 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
8 0.07865902 1361 high scalability-2012-11-22-Gone Fishin': PlentyOfFish Architecture
9 0.074792989 489 high scalability-2009-01-11-17 Distributed Systems and Web Scalability Resources
10 0.068919495 511 high scalability-2009-02-12-MySpace Architecture
11 0.065024793 714 high scalability-2009-10-02-HighScalability has Moved to Squarespace.com!
12 0.064417757 841 high scalability-2010-06-14-How scalable could be a cPanel Hosting service?
13 0.06377098 1191 high scalability-2012-02-13-Tumblr Architecture - 15 Billion Page Views a Month and Harder to Scale than Twitter
15 0.063262127 513 high scalability-2009-02-16-Handle 1 Billion Events Per Day Using a Memory Grid
16 0.063057944 1461 high scalability-2013-05-20-The Tumblr Architecture Yahoo Bought for a Cool Billion Dollars
17 0.062809408 52 high scalability-2007-08-01-Product: Memcached
18 0.062692255 190 high scalability-2007-12-22-This was a porn-spam post
19 0.062682539 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
20 0.062468115 200 high scalability-2008-01-02-WEB hosting Select
topicId topicWeight
[(0, 0.059), (1, 0.015), (2, -0.002), (3, -0.059), (4, -0.012), (5, -0.039), (6, -0.041), (7, 0.004), (8, 0.033), (9, 0.038), (10, -0.001), (11, -0.003), (12, 0.011), (13, 0.016), (14, -0.046), (15, 0.034), (16, 0.005), (17, -0.038), (18, -0.003), (19, 0.01), (20, 0.014), (21, 0.002), (22, -0.022), (23, -0.037), (24, 0.035), (25, -0.035), (26, -0.031), (27, 0.029), (28, 0.02), (29, 0.015), (30, 0.024), (31, -0.003), (32, 0.001), (33, 0.047), (34, 0.002), (35, 0.007), (36, -0.006), (37, 0.035), (38, 0.045), (39, 0.031), (40, 0.004), (41, -0.001), (42, -0.023), (43, 0.038), (44, 0.026), (45, 0.06), (46, 0.042), (47, -0.021), (48, 0.005), (49, 0.007)]
simIndex simValue blogId blogTitle
same-blog 1 0.95229995 133 high scalability-2007-10-26-How Gravatar scales on WordPress.com hardware
Introduction: Automattic recently purchase Gravatar and have switched the server onto their hosting platform. WordPress.com host over 1.7 million blogs with well over 60'000 new posts submitted each day generating 10 - 12 million page views per day. Barry on WordPress.com has a great post on the changes they've introduced to help Gravatar scale .
2 0.6487574 638 high scalability-2009-06-26-PlentyOfFish Architecture
Introduction: Update 5 : PlentyOfFish Update - 6 Billion Pageviews And 32 Billion Images A Month Update 4 : Jeff Atwood costs out Markus' scale up approach against a scale out approach and finds scale up wanting. The discussion in the comments is as interesting as the article. My guess is Markus doesn't want to rewrite his software to work across a scale out cluster so even if it's more expensive scale up works better for his needs. Update 3 : POF now has 200 million images and serves 10,000 images served per second. They'll be moving to a 250,000 IOPS RamSan to handle the load. Also upgraded to a core database machine with 512 GB of RAM, 32 CPU’s, SQLServer 2008 and Windows 2008. Update 2 : This seems to be a POF Peer1 love fest infomercial . It's pretty content free, but the production values are high. Lots of quirky sounds and fish swimming on the screen. Update : by Facebook standards Read/WriteWeb says POF is worth a cool one billion dollars . It helps to talk like Dr. Evil whe
3 0.64635676 1361 high scalability-2012-11-22-Gone Fishin': PlentyOfFish Architecture
Introduction: Other than StackOverflow , PlentyOfFish is perhaps the most spectacular example of scale-up architectures working for what your average sane person would consider a large system. It doesn't hurt that it's also a sexy story. Update 5 : PlentyOfFish Update - 6 Billion Pageviews And 32 Billion Images A Month Update 4 : Jeff Atwood costs out Markus' scale up approach against a scale out approach and finds scale up wanting. The discussion in the comments is as interesting as the article. My guess is Markus doesn't want to rewrite his software to work across a scale out cluster so even if it's more expensive scale up works better for his needs. Update 3 : POF now has 200 million images and serves 10,000 images served per second. They'll be moving to a 250,000 IOPS RamSan to handle the load. Also upgraded to a core database machine with 512 GB of RAM, 32 CPU’s, SQLServer 2008 and Windows 2008. Update 2 : This seems to be a POF Peer1 love fest infomercial . It's pretty cont
4 0.63771999 1164 high scalability-2011-12-27-PlentyOfFish Update - 6 Billion Pageviews and 32 Billion Images a Month
Introduction: Markus has a short update on their PlentyOfFish Architecture . Impressive November statistics: 6 billion pageviews served 32 billion images served 6 million logins i n one day IM servers handle about 30 billion pageviews 11 webservers (5 of which could be dropped) Hired first DBA in July . They currently have a handful of employees . All hosting/cdn costs combined are under $70k/month. Lesson : small organization, simple architecture, on raw hardware is still plenty profitable for PlentyOfFish. Related Articles On HackerNews 32 Billion images a month by Markus Frind.
5 0.59374607 519 high scalability-2009-02-23-Database Sharding at Netlog, with MySQL and PHP
Introduction: Jurriaan Persyn is a Lead Web Developer at Netlog, a social portal site that gets 50 million unique visitors and 5+ billion page views per month. In this paper Jurriaan goes into a lot of excellent nuts and bolts details about how they used sharding to scale their system. If you are pondering sharding as a solution to your scaling problems you'll want to read this paper. As the paper is quite well organized there's no reason to write a summary, but I especially liked this part from the conclusion: If you can do with simpler solutions (better hardware, more hardware, server tweaking and tuning, vertical partitioning, sql query optimization, ...) that require less development cost, why invest lots of effort in sharding? On the other hand, when your visitor statistics really start blowing through the roof, it is a good direction to go. After all, it worked for us.
6 0.56425941 513 high scalability-2009-02-16-Handle 1 Billion Events Per Day Using a Memory Grid
7 0.55568701 460 high scalability-2008-12-05-Scalability Perspectives #4: Kevin Kelly – One Machine
8 0.55372214 52 high scalability-2007-08-01-Product: Memcached
9 0.54750282 106 high scalability-2007-10-02-Secrets to Fotolog's Scaling Success
11 0.54417235 903 high scalability-2010-09-17-Hot Scalability Links For Sep 17, 2010
12 0.54286909 928 high scalability-2010-10-26-Scaling DISQUS to 75 Million Comments and 17,000 RPS
13 0.54209912 788 high scalability-2010-03-04-How MySpace Tested Their Live Site with 1 Million Concurrent Users
14 0.53346747 1329 high scalability-2012-09-26-WordPress.com Serves 70,000 req-sec and over 15 Gbit-sec of Traffic using NGINX
15 0.52581966 511 high scalability-2009-02-12-MySpace Architecture
16 0.52509087 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
17 0.50615412 1123 high scalability-2011-09-23-The Real News is Not that Facebook Serves Up 1 Trillion Pages a Month…
18 0.49437144 600 high scalability-2009-05-15-Wolfram|Alpha Architecture
19 0.49348006 190 high scalability-2007-12-22-This was a porn-spam post
20 0.49185711 425 high scalability-2008-10-22-Scalability Best Practices: Lessons from eBay
topicId topicWeight
[(1, 0.142), (61, 0.137), (81, 0.414), (85, 0.112)]
simIndex simValue blogId blogTitle
same-blog 1 0.75426358 133 high scalability-2007-10-26-How Gravatar scales on WordPress.com hardware
Introduction: Automattic recently purchase Gravatar and have switched the server onto their hosting platform. WordPress.com host over 1.7 million blogs with well over 60'000 new posts submitted each day generating 10 - 12 million page views per day. Barry on WordPress.com has a great post on the changes they've introduced to help Gravatar scale .
2 0.53853571 540 high scalability-2009-03-16-Cisco and Sun to Compete for Unified Computing?
Introduction: A recent InfoWorld article claims that "With Cisco expected to enter the blade market and Sun expected to offer networking equipment, things could get interesting awfully fast." How does this effect your infrastructure strategy and decisions? Would you consider to build scalable web applications on the Cisco Unified Computing System? Or would you consider to build a router out of a server with the use of OpenSolaris and Project Crossbow as the article suggests? Will any of these initiatives change the way we build scalable web infrastructure or are these just attempts to sale these systems? What do you think?
Introduction: Who's Hiring? Playfish is hiring an Engineering Director, Marketing & CRM and a Sr. Systems Operation Engineer . Electronic Arts Mobile is looking for Server Engineers . Tagged is hiring Engineers, Product Managers, Game Designers , and more. Undertone is looking for a Software Engineer and a QA Engineer . Box.net is Looking for a Software Engineer . Wiredrive is looking for an Operations Engineer deviantART is Hiring a Web Application Developer Fun and Informative Events Membase Meetups Coming to Major US Cities. The first of these technical meetups is on October 28 at Zynga’s San Francisco offices. Cool Products and Services Learn how Kabam enlisted Joyent to be the cloud environment for its growing game empire. http://www.joyent.com/customers/kabam/ CloudSigma . Instantly scalable European cloud servers. ManageEngine Applications Manager : Monitor physical, virtual and Cloud Applications . www.site24x7.com : Monit
4 0.42693454 100 high scalability-2007-09-26-Use a CDN to Instantly Improve Your Website's Performance by 20% or More
Introduction: If you have a lot of static content to store and you aren't looking forward to setting up and maintaining your own giganto SAN, maybe you can push off a lot of the hard lifting to a CDN? Jesse Robbins at O'Reilly Radar posts that you have a lot more options now because the number of Content Distribution Networks have doubled since last year . In fact, Dan Rayburn says there are now 28 CDN providers in the market. Hopefully you can find reasonable pricing at one of them. Other than easing your burden, why might a CDN work for you? Because it makes your site faster and customers like that. How can a CDN so dramatically improve your site's performance? Steve Saunders, author of High Performance Web Sites: Essential Knowledge for Front-End Engineers , has using a CDN has one of his "Thirteen Simple Rules for Speeding Up Your Web Site." About CDNs Steve says: Remember that 80-90% of the end-user response time is spent downloading all the components in
Introduction: Who's Hiring? Appirio is hiring 5 core product engineers for one of Silicon's Valley's "most promising startups". Tuenti is hiring both a FrontEnd and BackEnd Engineer . Playfish is hiring an Engineering Director, Marketing & CRM and a Sr. Systems Operation Engineer . Electronic Arts Mobile is looking for Server Engineers . Tagged is hiring Engineers, Product Managers, Game Designers , and more. Undertone is looking for a Software Engineer and a QA Engineer . Fun and Informative Events Membase Meetups Coming to Major US Cities. The first of these technical meetups is on October 28 at Zynga’s San Francisco offices. Cool Products and Services Learn how Kabam enlisted Joyent to be the cloud environment for its growing game empire. http://www.joyent.com/customers/kabam/ CloudSigma . Instantly scalable European cloud servers. ManageEngine Applications Manager : Monitor physical, virtual and Cloud Applications . www.site24x7
6 0.41996109 773 high scalability-2010-02-06-GEO-aware traffic load balancing and caching at CNBC.com
9 0.3990691 19 high scalability-2007-07-16-Paper: Replication Under Scalable Hashing
10 0.39883143 646 high scalability-2009-07-01-Podcast about Facebook's Cassandra Project and the New Wave of Distributed Databases
11 0.37359118 641 high scalability-2009-06-29-Google App Engine plus Amazon AWS: Best of both worlds
12 0.36854628 36 high scalability-2007-07-28-Product: Web Log Expert
13 0.3664571 492 high scalability-2009-01-16-Database Sharding for startups
14 0.36454892 1150 high scalability-2011-12-02-Stuff The Internet Says On Scalability For December 2, 2011
15 0.36372381 102 high scalability-2007-09-27-Product: Sequoia Database Clustering Technology
16 0.36321303 41 high scalability-2007-07-30-Product: Flickr
17 0.36229041 296 high scalability-2008-04-03-Development of highly scalable web site
18 0.36222836 386 high scalability-2008-09-22-Cloud computing, grid computing, utility computing - list of top providers
19 0.36040902 1039 high scalability-2011-05-12-Paper: Mind the Gap: Reconnecting Architecture and OS Research
20 0.35964903 479 high scalability-2008-12-29-Platform virtualization - top 25 providers (software, hardware, combined)