high_scalability high_scalability-2010 high_scalability-2010-886 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: This a follow-up post to an earlier post on the Scaling Rails Screencast Series by Gregg Pollack , when there were only 13 screencasts, now there are 21. Eight more have been added on topics like load testing and database scaling. This series is of surprisingly high quality. While I didn't view every screencast, I sampled a large set and found them to have solid content and high production values. In fact, how did they make these things? The instructor moves around in a little box while the content flows around him. A very cool effect. But that wouldn't matter if the content didn't deliver, here's what's new: Episode #14 - Rack & Metal Episode #15 - Load Testing - Part 1 Episode #16 - Load Testing - Part 2 Episode #17 - Scaling Your Database - Part 1 Episode #18 - Scaling Your Database - Part 2 Episode #19 - On The Edge - Part 1 Episode #20 - On The Edge - Part 2 Episode #21 - On The Edge - Part 3 The courses while targeted at Rails are more generally applica
sentIndex sentText sentNum sentScore
1 This a follow-up post to an earlier post on the Scaling Rails Screencast Series by Gregg Pollack , when there were only 13 screencasts, now there are 21. [sent-1, score-0.096]
2 Eight more have been added on topics like load testing and database scaling. [sent-2, score-0.475]
3 While I didn't view every screencast, I sampled a large set and found them to have solid content and high production values. [sent-4, score-0.419]
4 The instructor moves around in a little box while the content flows around him. [sent-6, score-0.733]
5 When you learn about caching and database scaling, for example, you are learning general concepts, not just Rails specific idioms, so take a look even if you aren't a Rails developer. [sent-9, score-0.409]
6 Gregg has started a new site called EnvyCasts , which features a line of similar screencasts. [sent-10, score-0.172]
7 PeepCode is also in this space, if you are looking for even more learnin'. [sent-11, score-0.058]
8 I was also curious if people like to learn this way? [sent-12, score-0.187]
wordName wordTfidf (topN-words)
[('screencasts', 0.396), ('rails', 0.338), ('screencast', 0.31), ('part', 0.265), ('edge', 0.232), ('idioms', 0.179), ('instructor', 0.179), ('testing', 0.164), ('pollack', 0.161), ('poston', 0.146), ('gregg', 0.146), ('teaching', 0.142), ('sampled', 0.142), ('content', 0.142), ('scaling', 0.131), ('series', 0.129), ('courses', 0.126), ('episode', 0.122), ('eight', 0.113), ('curious', 0.104), ('concepts', 0.099), ('flows', 0.099), ('rack', 0.097), ('earlier', 0.096), ('moves', 0.096), ('targeted', 0.094), ('surprisingly', 0.091), ('database', 0.088), ('load', 0.087), ('learn', 0.083), ('solid', 0.08), ('topics', 0.079), ('around', 0.078), ('effective', 0.075), ('generally', 0.073), ('deliver', 0.07), ('matter', 0.063), ('fact', 0.063), ('learning', 0.062), ('box', 0.061), ('specific', 0.059), ('general', 0.059), ('line', 0.058), ('started', 0.058), ('even', 0.058), ('added', 0.057), ('similar', 0.056), ('view', 0.055), ('space', 0.054), ('cool', 0.052)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 886 high scalability-2010-08-24-21 Quality Screencasts on Scaling Rails
Introduction: This a follow-up post to an earlier post on the Scaling Rails Screencast Series by Gregg Pollack , when there were only 13 screencasts, now there are 21. Eight more have been added on topics like load testing and database scaling. This series is of surprisingly high quality. While I didn't view every screencast, I sampled a large set and found them to have solid content and high production values. In fact, how did they make these things? The instructor moves around in a little box while the content flows around him. A very cool effect. But that wouldn't matter if the content didn't deliver, here's what's new: Episode #14 - Rack & Metal Episode #15 - Load Testing - Part 1 Episode #16 - Load Testing - Part 2 Episode #17 - Scaling Your Database - Part 1 Episode #18 - Scaling Your Database - Part 2 Episode #19 - On The Edge - Part 1 Episode #20 - On The Edge - Part 2 Episode #21 - On The Edge - Part 3 The courses while targeted at Rails are more generally applica
2 0.15613845 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
Introduction: Update: Jake in Does Django really scale better than Rails? thinks apps like FFS shouldn't need so much hardware to scale. In a short three months Friends for Sale (think Hot-or-Not with a market economy) grew to become a top 10 Facebook application handling 200 gorgeous requests per second and a stunning 300 million page views a month. They did all this using Ruby on Rails, two part time developers, a cluster of a dozen machines, and a fairly standard architecture. How did Friends for Sale scale to sell all those beautiful people? And how much do you think your friends are worth on the open market? Site: http://www.facebook.com/apps/application.php?id=7019261521 Information Sources Siqi Chen and Alexander Le, co-creators of Friends for Sale, answering my standard questionairre. Virality on Facebook The Platform Ruby on Rails CentOS 5 (64 bit) Capistrano - update and restart application servers. Memcached MySQL Nginx Starling - distrib
3 0.12519613 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
Introduction: Several months ago I attended a Joyent presentation where the spokesman hinted that Joyent had the chops to support a one billion page per month Facebook Ruby on Rails application. Even under a few seconds of merciless grilling he would not give up the name of the application. Now we have the big reveal: it was LinkedIn's Bumper Sticker app. For those not currently sticking things on bumps, Bumper Sticker is quite surprisingly a viral media sharing application that allows users to express their individuality by sticking small virtual stickers on Facebook profiles . At the time I was quite curious how Joyent's cloud approach could be leveraged for this kind of app. Now that they've released a few details, we get to find out. Site: http://www.Facebook.com/apps/application.php?id=2427603417 Information Sources Video: Scaling to 1 Billion Page Views Per MonthVideo (very flashy) Web Scalability Practices: Bumper Sticker on Rails by Ikai Lan and Jim Meyer from LinkedIn 1
4 0.12442479 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
Introduction: Update 6: Some interesting changes from Twitter's Evan Weaver : everything in RAM now, database is a backup; peaks at 300 tweets/second; every tweet followed by average 126 people; vector cache of tweet IDs; row cache; fragment cache; page cache; keep separate caches; GC makes Ruby optimization resistant so went with Scala; Thrift and HTTP are used internally; 100s internal requests for every external request; rewrote MQ but kept interface the same; 3 queues are used to load balance requests; extensive A/B testing for backwards capability; switched to C memcached client for speed; optimize critical path; faster to get the cached results from the network memory than recompute them locally. Update 5: Twitter on Scala . A Conversation with Steve Jenson, Alex Payne, and Robey Pointer by Bill Venners. A fascinating discussion of why Twitter moved to the Java JVM for their server infrastructure (long lived processes) and why they moved to Scala to program against it (high level langu
5 0.12316719 1303 high scalability-2012-08-13-Ask HighScalability: Facing scaling issues with news feeds on Redis. Any advice?
Introduction: We just released a social section to our iOS app several days ago and we are already facing scaling issues with the users' news feeds. We're basically using a Fan-out-on-write (push) model for the users' news feeds (posts of people and topics they follow) and we're using Redis for this (backend is Rails on Heroku). However, our current 60,000 news feeds is ballooning our Redis store to almost 1GB in a just a few days (it's growing way too fast for our budget). Currently we're storing the entire news feed for the user (post id, post text, author, icon url, etc) and we cap the entries to 300 per feed. I'm wondering if we need to just store the post IDs of each user feed in Redis and then store the rest of the post information somewhere else? Would love some feedback here. In this case, our iOS app would make an api call to our Rails app to retrieve a user's news feed. Rails app would retrieve news feed list (just post IDs) from Redis, and then Rails app would need to query to g
6 0.11232392 530 high scalability-2009-03-11-13 Screencasts on How to Scale Rails
7 0.10122699 576 high scalability-2009-04-21-What CDN would you recommend?
9 0.089665867 820 high scalability-2010-05-03-100 Node Hazelcast cluster on Amazon EC2
10 0.08387357 569 high scalability-2009-04-14-Scalability resources
11 0.083209895 574 high scalability-2009-04-20-Some things about Memcached from a Twitter software developer
12 0.079542346 1333 high scalability-2012-10-04-LinkedIn Moved from Rails to Node: 27 Servers Cut and Up to 20x Faster
13 0.078287005 382 high scalability-2008-09-09-Content Delivery Networks (CDN) – a comprehensive list of providers
14 0.078000173 552 high scalability-2009-04-01-Art of scalability (1) - Scalability principles
15 0.076110728 856 high scalability-2010-07-12-Creating Scalable Digital Libraries
16 0.075806297 417 high scalability-2008-10-15-Outside.in Scales Up with Engine Yard and moving from PHP to Ruby on Rails
17 0.073996857 194 high scalability-2007-12-26-Golden rule of web caching
18 0.073027924 692 high scalability-2009-09-01-Cheap storage: how backblaze takes matters in hand
19 0.072622247 796 high scalability-2010-03-16-Justin.tv's Live Video Broadcasting Architecture
20 0.07233195 1423 high scalability-2013-03-13-Iron.io Moved From Ruby to Go: 28 Servers Cut and Colossal Clusterf**ks Prevented
topicId topicWeight
[(0, 0.121), (1, 0.04), (2, -0.011), (3, -0.055), (4, 0.024), (5, -0.051), (6, -0.051), (7, -0.01), (8, -0.015), (9, 0.031), (10, 0.005), (11, -0.028), (12, -0.033), (13, -0.007), (14, -0.02), (15, -0.032), (16, 0.028), (17, -0.029), (18, -0.02), (19, -0.012), (20, -0.046), (21, -0.0), (22, -0.021), (23, -0.01), (24, -0.012), (25, 0.037), (26, -0.02), (27, 0.027), (28, -0.005), (29, 0.054), (30, -0.002), (31, -0.02), (32, -0.018), (33, 0.051), (34, -0.054), (35, -0.05), (36, -0.04), (37, -0.021), (38, -0.025), (39, -0.041), (40, -0.009), (41, -0.055), (42, 0.034), (43, 0.036), (44, -0.025), (45, 0.045), (46, 0.009), (47, 0.013), (48, -0.003), (49, -0.04)]
simIndex simValue blogId blogTitle
same-blog 1 0.94552481 886 high scalability-2010-08-24-21 Quality Screencasts on Scaling Rails
Introduction: This a follow-up post to an earlier post on the Scaling Rails Screencast Series by Gregg Pollack , when there were only 13 screencasts, now there are 21. Eight more have been added on topics like load testing and database scaling. This series is of surprisingly high quality. While I didn't view every screencast, I sampled a large set and found them to have solid content and high production values. In fact, how did they make these things? The instructor moves around in a little box while the content flows around him. A very cool effect. But that wouldn't matter if the content didn't deliver, here's what's new: Episode #14 - Rack & Metal Episode #15 - Load Testing - Part 1 Episode #16 - Load Testing - Part 2 Episode #17 - Scaling Your Database - Part 1 Episode #18 - Scaling Your Database - Part 2 Episode #19 - On The Edge - Part 1 Episode #20 - On The Edge - Part 2 Episode #21 - On The Edge - Part 3 The courses while targeted at Rails are more generally applica
2 0.66275287 356 high scalability-2008-07-22-Scaling Bumper Sticker: A 1 Billion Page Per Month Facebook RoR App
Introduction: Several months ago I attended a Joyent presentation where the spokesman hinted that Joyent had the chops to support a one billion page per month Facebook Ruby on Rails application. Even under a few seconds of merciless grilling he would not give up the name of the application. Now we have the big reveal: it was LinkedIn's Bumper Sticker app. For those not currently sticking things on bumps, Bumper Sticker is quite surprisingly a viral media sharing application that allows users to express their individuality by sticking small virtual stickers on Facebook profiles . At the time I was quite curious how Joyent's cloud approach could be leveraged for this kind of app. Now that they've released a few details, we get to find out. Site: http://www.Facebook.com/apps/application.php?id=2427603417 Information Sources Video: Scaling to 1 Billion Page Views Per MonthVideo (very flashy) Web Scalability Practices: Bumper Sticker on Rails by Ikai Lan and Jim Meyer from LinkedIn 1
3 0.66135275 530 high scalability-2009-03-11-13 Screencasts on How to Scale Rails
Introduction: Gregg Pollack has made 13 screen casts on how to scale rails: Episode #1 - Page Responsiveness Episode #2 - Page Caching Episode #3 - Cache Expiration Episode #4 - New Relic RPM Episode #5 - Advanced Page Caching Episode #6 - Action Caching Episode #7 - Fragment Caching Episode #8 - Memcached Episode #9 - Taylor Weibley & Databases Episode #10 - Client-side Caching Episode #11 - Advanced HTTP Caching Episode #12 - Jesse Newland & Deployment Episode #13 - Jim Gochee & Advanced RPM For a good InfoQ interview with Greg take a look at Gregg Pollack and the How-To of Scaling Rails .
Introduction: Update 4: Heroku versus GAE & GAE/J Update 3 : Heroku has gone live! . Congratulations to the team. It's difficult right now to get a feeling for the relative cost and reliability of Heroku, but it's an impressive accomplishment and a viable option for people looking for a delivery platform. Update 2 : Heroku Architecture . A great interactive presentation of the Heroku stack. Requests flow into Nginx used as a HTTP Reverse Proxy. Nginx routes requests into a Varnish based HTTP cache. Then requests are injected into an Erlang based routing mesh that balances requests across a grid of dynos. Dynos are your application "VMs" that implement application specific behaviors. Dynos themselves are a stack of: POSIX, Ruby VM, App Server, Rack, Middleware, Framework, Your App. Applications can access PostgreSQL. Memcached is used as an application caching layer. Update : Aaron Worsham Interview with James Lindenbaum, CEO of Heroku . Aaron nicely sums up their goal: Heroku is
5 0.63829541 1401 high scalability-2013-02-06-Super Bowl Advertisers Ready for the Traffic? Nope..It's Lights Out.
Introduction: Advertising for the Super Bowl is bigger than the game for many viewers. So you gotta figure advertisers are ready for the traffic bursts generated by their expensive ads? Not exactly... Yottaa reports an amazing 13 advertiser websites crashed during the Super Bowl. Coke was interactively au currant, asking viewers to vote for the ending of a commercial, but load times went to 62 seconds. SodaStream, Calvin Klein, Axe, Got Milk? The Walking Dead, many movie sites, and many car sites, all were flagged with delay of fame penalties. Lots of time, money, and creative energy is spent lovingly perfecting every detail of these commercials. It won't be a surprise to any programmer that this can't usually be said of the follow through on the backend. So what can you do? Yottaa has some good tips and Michael Hamrah has a wonderful post on dealing with the Super Bowl Burst Problem: Yottaa's tips: Reduce the number of assets and asset weight to create smaller, more lightweight page
6 0.63561201 970 high scalability-2011-01-06-BankSimple Mini-Architecture - Using a Next Generation Toolchain
7 0.63098294 1330 high scalability-2012-09-28-Stuff The Internet Says On Scalability For September 28, 2012
8 0.62996787 390 high scalability-2008-09-23-Scaling your cookie recipes
9 0.62230825 639 high scalability-2009-06-27-Scaling Twitter: Making Twitter 10000 Percent Faster
10 0.62111324 506 high scalability-2009-02-03-10 More Rules for Even Faster Websites
11 0.60888159 556 high scalability-2009-04-05-At Some Point the Cost of Servers Outweighs the Cost of Programmers
12 0.60850346 1613 high scalability-2014-03-17-Intuitively Showing How To Scale a Web Application Using a Coffee Shop as an Example
13 0.59933931 1052 high scalability-2011-06-03-Stuff The Internet Says On Scalability For June 3, 2011
14 0.59546489 948 high scalability-2010-11-24-Great Introductory Video on Scalability from Harvard Computer Science
15 0.59492117 518 high scalability-2009-02-22-Building and Scaling a Startup on Rails: 12 Things We Learned the Hard Way
16 0.59406513 1615 high scalability-2014-03-19-Strategy: Three Techniques to Survive Traffic Surges by Quickly Scaling Your Site
17 0.58989996 230 high scalability-2008-01-29-Speed up (Oracle) database code with result caching
18 0.58589816 1325 high scalability-2012-09-19-The 4 Building Blocks of Architecting Systems for Scale
19 0.58450919 344 high scalability-2008-06-09-FaceStat's Rousing Tale of Scaling Woe and Wisdom Won
20 0.58334607 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
topicId topicWeight
[(1, 0.098), (2, 0.254), (10, 0.014), (12, 0.295), (61, 0.104), (79, 0.077), (85, 0.014), (94, 0.025)]
simIndex simValue blogId blogTitle
1 0.86791468 278 high scalability-2008-03-16-Product: GlusterFS
Introduction: Adapted from their website: GlusterFS is a clustered file-system capable of scaling to several peta-bytes. It aggregates various storage bricks over Infiniband RDMA or TCP/IP interconnect into one large parallel network file system. Storage bricks can be made of any commodity hardware such as x86-64 server with SATA-II RAID and Infiniband HBA). Cluster file systems are still not mature for enterprise market. They are too complex to deploy and maintain though they are extremely scalable and cheap. Can be entirely built out of commodity OS and hardware. GlusterFS hopes to solves this problem. GlusterFS achieved 35 GBps read throughput . The GlusterFS Aggregated I/O Benchmark was performed on 64 bricks clustered storage system over 10 Gbps Infiniband interconnect. A cluster of 220 clients pounded the storage system with multiple dd (disk-dump) instances, each reading / writing a 1 GB file with 1MB block size. GlusterFS was configured with unify translator and round-robin scheduler
2 0.84175372 161 high scalability-2007-11-20-Product: SmartFrog a Distributed Configuration and Deployment Framework
Introduction: From Wikipedia : SmartFrog is an open-source software framework, written in Java, that manages the configuration, deployment and coordination of a software system broken into components. These components may be distributed across several network hosts. The configuration of components is described using a domain-specific language, whose syntax resembles that of Java. It is a prototype-based object-oriented language, and may thus be compared to Self. The framework is used internally in a variety of HP products. Also, it is being used by HP Labs partners like CERN. Related Articles Distributed Testing with SmartFrog Puppet the Automated Administration System
3 0.82551229 3 high scalability-2007-07-09-LiveJournal Architecture
Introduction: A fascinating and detailed story of how LiveJournal evolved their system to scale. LiveJournal was an early player in the free blog service race and faced issues from quickly adding a large number of users. Blog posts come fast and furious which causes a lot of writes and writes are particularly hard to scale. Understanding how LiveJournal faced their scaling problems will help any aspiring website builder. Site: http://www.livejournal.com/ Information Sources LiveJournal - Behind The Scenes Scaling Storytime Google Video Tokyo Video 2005 version Platform Linux MySql Perl Memcached MogileFS Apache What's Inside? Scaling from 1, 2, and 4 hosts to cluster of servers. Avoid single points of failure. Using MySQL replication only takes you so far. Becoming IO bound kills scaling. Spread out writes and reads for more parallelism. You can't keep adding read slaves and scale. Shard storage approach, using DRBD, for maxim
same-blog 4 0.81604296 886 high scalability-2010-08-24-21 Quality Screencasts on Scaling Rails
Introduction: This a follow-up post to an earlier post on the Scaling Rails Screencast Series by Gregg Pollack , when there were only 13 screencasts, now there are 21. Eight more have been added on topics like load testing and database scaling. This series is of surprisingly high quality. While I didn't view every screencast, I sampled a large set and found them to have solid content and high production values. In fact, how did they make these things? The instructor moves around in a little box while the content flows around him. A very cool effect. But that wouldn't matter if the content didn't deliver, here's what's new: Episode #14 - Rack & Metal Episode #15 - Load Testing - Part 1 Episode #16 - Load Testing - Part 2 Episode #17 - Scaling Your Database - Part 1 Episode #18 - Scaling Your Database - Part 2 Episode #19 - On The Edge - Part 1 Episode #20 - On The Edge - Part 2 Episode #21 - On The Edge - Part 3 The courses while targeted at Rails are more generally applica
5 0.81477821 82 high scalability-2007-09-06-Why doesn't anyone use j2ee?
Introduction: From a reader: > Was reading through your very interesting/useful site. >Most of the architectures are non j2ee-Does that mean that >there aren't enough websites that are scalable(with youtube > like userbase) built with j2ee tech-would like to know if there > are any and their architecture as >well. eBay uses Java, but in a very pragmatic way. They use servlets, an application server, the JDK, and they do the rest themselves. They skip JSP, entity beans, and JMS. When you need to scale putting all your eggs in one basket is a risky strategy. Why use JSP when you can do better? When use entity beans when you can do better? Use servlets because they are a very effective way of handling http requests. Use Java because it is fast, runs everywhere, and has a boat load of libraries you can use to build your build your custom system. Probably the major reason J2EE is absentee is simply LAMP. LAMP is just so incredibly functional for most 2-tier shared nothing site
6 0.80994976 1352 high scalability-2012-10-31-Gone Fishin': LiveJournal Architecture
7 0.79534346 285 high scalability-2008-03-19-Serving JavaScript Fast
8 0.72541177 209 high scalability-2008-01-12-Gandi.net, french registrar launches in granular server resources.
9 0.71572924 1143 high scalability-2011-11-16-Google+ Infrastructure Update - the JavaScript Story
10 0.71129906 933 high scalability-2010-11-01-Hot Trend: Move Behavior to Data for a New Interactive Application Architecture
11 0.71117413 415 high scalability-2008-10-15-Need help with your Hadoop deployment? This company may help!
12 0.71113324 628 high scalability-2009-06-13-Neo4j - a Graph Database that Kicks Buttox
13 0.70967996 714 high scalability-2009-10-02-HighScalability has Moved to Squarespace.com!
14 0.70940936 1362 high scalability-2012-11-26-BigData using Erlang, C and Lisp to Fight the Tsunami of Mobile Data
15 0.70914912 248 high scalability-2008-02-13-What's your scalability plan?
16 0.70850867 1215 high scalability-2012-03-26-7 Years of YouTube Scalability Lessons in 30 Minutes
17 0.70792037 1438 high scalability-2013-04-10-Check Yourself Before You Wreck Yourself - Avocado's 5 Early Stages of Architecture Evolution
18 0.70705837 1065 high scalability-2011-06-21-Running TPC-C on MySQL-RDS
19 0.7069512 724 high scalability-2009-10-19-Drupal's Scalability Makeover - You give up some control and you get back scalability
20 0.70690471 672 high scalability-2009-08-06-An Unorthodox Approach to Database Design : The Coming of the Shard