high_scalability high_scalability-2008 high_scalability-2008-312 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Website stats: Webserver: Apache 2.2 Database: MySQL 5.0 APC cache for php CMS: Drupal 6.2 (bleeding-edge version)* *Aggressive caching is ON, Page Compression ON, Block Cache ON (can't use CCS),Optimize CSS/JS ON. 2 Servers: Apache/Mysql (low-tech servers - Celeron processors, 512 MB RAM, 7200 RPM HDD) Bandwidth 10 Mb/s The benchmark: Used ab : ab -n 1000 -c 20 howwhatwho.com Server Software: Apache/2.2.3 Server Hostname: howwhatwho.com Server Port: 80 Document Path: / Document Length: 41639 bytes Concurrency Level: 20 Time taken for tests: 13.556796 seconds Complete requests: 1000 Failed requests: 0 Write errors: 0 Total transferred: 42118000 bytes HTML transferred: 41639000 bytes Requests per second: 73.76 [#/sec] (mean) Time per request: 271.136 [ms] (mean) Time per request: 13.557 [ms] (mean, across all concurrent requests) Transfer rate: 3033.90 [Kbytes/sec] received
sentIndex sentText sentNum sentScore
1 2 Servers: Apache/Mysql (low-tech servers - Celeron processors, 512 MB RAM, 7200 RPM HDD) Bandwidth 10 Mb/s The benchmark: Used ab : ab -n 1000 -c 20 howwhatwho. [sent-5, score-0.632]
2 com Server Port: 80 Document Path: / Document Length: 41639 bytes Concurrency Level: 20 Time taken for tests: 13. [sent-9, score-0.076]
3 556796 seconds Complete requests: 1000 Failed requests: 0 Write errors: 0 Total transferred: 42118000 bytes HTML transferred: 41639000 bytes Requests per second: 73. [sent-10, score-0.097]
4 557 [ms] (mean, across all concurrent requests) Transfer rate: 3033. [sent-13, score-0.073]
5 90 [Kbytes/sec] received The Apache server is also running the postifx and bind although they aren't resource intensive applications. [sent-14, score-0.32]
6 The Cron job for drupal runs every 50 minutes, and the agreggator module is enabled and fetches more than 30 rss feeds every time. [sent-15, score-1.018]
7 The site used to be hosted on a single Celeron machine but on peak times the CPU went up to 80 %. [sent-16, score-0.295]
8 Question : Does anybody know a website hosted on an IBM Mainframe? [sent-17, score-0.377]
wordName wordTfidf (topN-words)
[('celeron', 0.377), ('ab', 0.316), ('transferred', 0.257), ('drupal', 0.243), ('ms', 0.194), ('mean', 0.189), ('fetches', 0.163), ('hostname', 0.15), ('mainframe', 0.146), ('hosted', 0.145), ('requests', 0.144), ('webserver', 0.138), ('bind', 0.138), ('todd', 0.136), ('hdd', 0.134), ('anybody', 0.134), ('apache', 0.129), ('rss', 0.124), ('aggressive', 0.123), ('rpm', 0.117), ('length', 0.116), ('request', 0.114), ('cron', 0.114), ('mb', 0.112), ('port', 0.11), ('module', 0.108), ('enabled', 0.108), ('transfer', 0.099), ('website', 0.098), ('per', 0.097), ('compression', 0.096), ('although', 0.092), ('errors', 0.091), ('intensive', 0.09), ('feeds', 0.089), ('benchmark', 0.087), ('cache', 0.086), ('stats', 0.083), ('processors', 0.083), ('block', 0.082), ('peak', 0.082), ('path', 0.079), ('tests', 0.077), ('taken', 0.076), ('concurrent', 0.073), ('went', 0.068), ('ibm', 0.067), ('rate', 0.063), ('every', 0.061), ('runs', 0.061)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999976 312 high scalability-2008-04-30-Rather small site architecture.
Introduction: Website stats: Webserver: Apache 2.2 Database: MySQL 5.0 APC cache for php CMS: Drupal 6.2 (bleeding-edge version)* *Aggressive caching is ON, Page Compression ON, Block Cache ON (can't use CCS),Optimize CSS/JS ON. 2 Servers: Apache/Mysql (low-tech servers - Celeron processors, 512 MB RAM, 7200 RPM HDD) Bandwidth 10 Mb/s The benchmark: Used ab : ab -n 1000 -c 20 howwhatwho.com Server Software: Apache/2.2.3 Server Hostname: howwhatwho.com Server Port: 80 Document Path: / Document Length: 41639 bytes Concurrency Level: 20 Time taken for tests: 13.556796 seconds Complete requests: 1000 Failed requests: 0 Write errors: 0 Total transferred: 42118000 bytes HTML transferred: 41639000 bytes Requests per second: 73.76 [#/sec] (mean) Time per request: 271.136 [ms] (mean) Time per request: 13.557 [ms] (mean, across all concurrent requests) Transfer rate: 3033.90 [Kbytes/sec] received
2 0.21464473 724 high scalability-2009-10-19-Drupal's Scalability Makeover - You give up some control and you get back scalability
Introduction: Drupal 7 is having a scalability makeover. Karoly Negyesi, Drupal Core Developer and Public Development Team Lead, explains the process in this video: Drupal 7 APIs, scalability mindset . Karoly states the general theme of the changes as: You give up some control and you get back scalability . An interesting comment on the politics of scalability? Makeover may not be quite the right word though. A makeover implies a cosmetic change, looking better by changing the surface. Drupal's changes will go deeper than that, right to Drupal's core. It's a genuine and authentic change that will hopefully allow one of the Internet's most venerable Content Management Systems (CMSs) to compete with a constant stream of younger and sexier models. Drupal is based on an older LAMP stack approach where PHP modules are scooped up and merged together each time a request is made to Drupal. Drupal's most intriguing idea is how it is built, expands, and changes by weaving together a single system out
3 0.13496959 231 high scalability-2008-01-29-Too many databases
Introduction: Hi, I am using drupal for my clients website, and was thinking is it possible to host all ( about 500) of them on the same server(maybe VPS or dedicated). Here is the situation..... Each clients website has a database with about 50 tables each, all the databases are small in size about 2-5 MB .... and the websites are low traffic websites with say.. 50 hits/day on avg.... that means about 2000 queries/db/day ..... (avg 40 queries per hit).... Wanted to know if it is possible to have so many databases about 500 on the same server? what are the things that i should look into if i should make this happen?
4 0.11120933 66 high scalability-2007-08-16-What tech is used to build your favorite site?
Introduction: Find out with Builtwith.com. It scans a site and guesses how the site is built. I ran it on this site and it said: Apache, Windows, PHP, Adsense, RSS, CSS, Javascript, and UTF-8 encoding. Correct, yet I think it should have guessed Drupal was the CMS and it should have been able to determine which AJAX library is used. Though it's kind of cool to see which sites use PHP and other technologies.
5 0.10925068 16 high scalability-2007-07-16-Book: High Performance MySQL
Introduction: As users come to depend on MySQL, they find that they have to deal with issues of reliability, scalability, and performance--issues that are not well documented but are critical to a smoothly functioning site. This book is an insider's guide to these little understood topics. Author Jeremy Zawodny has managed large numbers of MySQL servers for mission-critical work at Yahoo!, maintained years of contacts with the MySQL AB team, and presents regularly at conferences. Jeremy and Derek have spent months experimenting, interviewing major users of MySQL, talking to MySQL AB, benchmarking, and writing some of their own tools in order to produce the information in this book. In High Performance MySQL you will learn about MySQL indexing and optimization in depth so you can make better use of these key features. You will learn practical replication, backup, and load-balancing strategies with information that goes beyond available tools to discuss their effects in real-life environments. And you
6 0.10769285 598 high scalability-2009-05-12-P2P server technology?
7 0.10490932 662 high scalability-2009-07-27-Handle 700 Percent More Requests Using Squid and APC Cache
8 0.099480651 169 high scalability-2007-12-01-many website, one setup, many databases
10 0.096245185 195 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half
11 0.093375057 1 high scalability-2007-07-06-Start Here
12 0.092495836 95 high scalability-2007-09-17-Scalable CMS?
13 0.091094129 7 high scalability-2007-07-12-FeedBurner Architecture
15 0.083448663 1456 high scalability-2013-05-13-The Secret to 10 Million Concurrent Connections -The Kernel is the Problem, Not the Solution
16 0.082861446 1065 high scalability-2011-06-21-Running TPC-C on MySQL-RDS
17 0.082698599 884 high scalability-2010-08-23-6 Ways to Kill Your Servers - Learning How to Scale the Hard Way
18 0.082290828 43 high scalability-2007-07-30-Product: ImageShack
19 0.080507517 585 high scalability-2009-04-29-How to choice and build perfect server
20 0.080425769 274 high scalability-2008-03-12-YouTube Architecture
topicId topicWeight
[(0, 0.115), (1, 0.051), (2, -0.043), (3, -0.121), (4, -0.026), (5, -0.012), (6, 0.021), (7, 0.021), (8, -0.02), (9, 0.006), (10, -0.026), (11, -0.07), (12, 0.053), (13, 0.03), (14, -0.005), (15, -0.047), (16, -0.018), (17, -0.013), (18, -0.023), (19, -0.02), (20, 0.011), (21, 0.006), (22, 0.007), (23, -0.022), (24, 0.035), (25, -0.018), (26, 0.024), (27, 0.021), (28, -0.005), (29, -0.043), (30, 0.007), (31, 0.025), (32, 0.027), (33, 0.063), (34, 0.019), (35, 0.049), (36, 0.052), (37, -0.01), (38, -0.027), (39, 0.036), (40, -0.003), (41, 0.004), (42, 0.05), (43, -0.074), (44, -0.028), (45, 0.025), (46, -0.058), (47, 0.014), (48, -0.007), (49, -0.041)]
simIndex simValue blogId blogTitle
same-blog 1 0.94878066 312 high scalability-2008-04-30-Rather small site architecture.
Introduction: Website stats: Webserver: Apache 2.2 Database: MySQL 5.0 APC cache for php CMS: Drupal 6.2 (bleeding-edge version)* *Aggressive caching is ON, Page Compression ON, Block Cache ON (can't use CCS),Optimize CSS/JS ON. 2 Servers: Apache/Mysql (low-tech servers - Celeron processors, 512 MB RAM, 7200 RPM HDD) Bandwidth 10 Mb/s The benchmark: Used ab : ab -n 1000 -c 20 howwhatwho.com Server Software: Apache/2.2.3 Server Hostname: howwhatwho.com Server Port: 80 Document Path: / Document Length: 41639 bytes Concurrency Level: 20 Time taken for tests: 13.556796 seconds Complete requests: 1000 Failed requests: 0 Write errors: 0 Total transferred: 42118000 bytes HTML transferred: 41639000 bytes Requests per second: 73.76 [#/sec] (mean) Time per request: 271.136 [ms] (mean) Time per request: 13.557 [ms] (mean, across all concurrent requests) Transfer rate: 3033.90 [Kbytes/sec] received
2 0.69821042 808 high scalability-2010-04-12-Poppen.de Architecture
Introduction: This is a guest a post by Alvaro Videla describing their architecture for Poppen.de , a popular German dating site. This site is very much NSFW, so be careful before clicking on the link. What I found most interesting is how they manage to sucessfully blend a little of the old with a little of the new, using technologies like Nginx, MySQL, CouchDB, and Erlang, Memcached, RabbitMQ, PHP, Graphite, Red5, and Tsung. What is Poppen.de? Poppen.de (NSFW) is the top dating website in Germany, and while it may be a small site compared to giants like Flickr or Facebook, we believe it's a nice architecture to learn from if you are starting to get some scaling problems. The Stats 2.000.000 users 20.000 concurrent users 300.000 private messages per day 250.000 logins per day We have a team of eleven developers, two designers and two sysadmins for this project. Business Model The site works with a freemium model, where users can do for free things like: Search
3 0.68833721 231 high scalability-2008-01-29-Too many databases
Introduction: Hi, I am using drupal for my clients website, and was thinking is it possible to host all ( about 500) of them on the same server(maybe VPS or dedicated). Here is the situation..... Each clients website has a database with about 50 tables each, all the databases are small in size about 2-5 MB .... and the websites are low traffic websites with say.. 50 hits/day on avg.... that means about 2000 queries/db/day ..... (avg 40 queries per hit).... Wanted to know if it is possible to have so many databases about 500 on the same server? what are the things that i should look into if i should make this happen?
4 0.68575239 662 high scalability-2009-07-27-Handle 700 Percent More Requests Using Squid and APC Cache
Introduction: This post on www.ilovebonnie.net documents some impressive system performance improvements by the addition of Squid Cache (a caching proxy) and APC Cache (opcode cache for PHP). Apache is able to deliver roughly 700% more requests per second with Squid when serving 1KB and 100KB images. Server load is reduced using Squid because the server does not have to create a bunch of Apache processes to handle the requests. APC Cache took a system that could barely handle 10-20 requests per second to handling 50-60 requests per second. A 400% increase. APC allowed the load times to remain under 5 seconds even with 200 concurrent threads slamming on the server. These two caches are easy to setup and install and allow you to get a lot more performance out of them. The post has an in-depth discussion and a number of supporting charts. The primary point is how simple it can be to improve performance and scalability by adding caching.
5 0.66344672 884 high scalability-2010-08-23-6 Ways to Kill Your Servers - Learning How to Scale the Hard Way
Introduction: This is a guest post by Steffen Konerow, author of the High Performance Blog . Learning how to scale isn’t easy without any prior experience. Nowadays you have plenty of websites like highscalability.com to get some inspiration, but unfortunately there is no solution that fits all websites and needs. You still have to think on your own to find a concept that works for your requirements. So did I. A few years ago, my bosses came to me and said “We’ve got a new project for you. It’s the relaunch of a website that has already 1 million users a month. You have to build the website and make sure we’ll be able to grow afterwards”. I was already an experienced coder, but not in these dimensions, so I had to start learning how to scale – the hard way. The software behind the website was a PHP content management system, based on Smarty and MySQL. The first task was finding a proper hosting company who had the experience and would also manage the servers for us. After some researc
6 0.66102403 248 high scalability-2008-02-13-What's your scalability plan?
7 0.65651697 314 high scalability-2008-05-03-Product: nginx
8 0.63357627 136 high scalability-2007-10-28-Scaling Early Stage Startups
9 0.62387455 573 high scalability-2009-04-16-Serving 250M quotes-day at CNBC.com with aiCache
10 0.60881376 728 high scalability-2009-10-26-Facebook's Memcached Multiget Hole: More machines != More Capacity
11 0.60764766 1640 high scalability-2014-04-30-10 Tips for Optimizing NGINX and PHP-fpm for High Traffic Sites
12 0.59978473 1486 high scalability-2013-07-03-5 Rockin' Tips for Scaling PHP to 30,000 Concurrent Users Per Server
13 0.59661418 256 high scalability-2008-02-21-Tracking usage of public resources - throttling accesses per hour
14 0.58261657 1401 high scalability-2013-02-06-Super Bowl Advertisers Ready for the Traffic? Nope..It's Lights Out.
15 0.57809252 1404 high scalability-2013-02-11-At Scale Even Little Wins Pay Off Big - Google and Facebook Examples
17 0.57399857 1644 high scalability-2014-05-07-Update on Disqus: It's Still About Realtime, But Go Demolishes Python
18 0.57370591 836 high scalability-2010-06-04-Strategy: Cache Larger Chunks - Cache Hit Rate is a Bad Indicator
19 0.57322055 1456 high scalability-2013-05-13-The Secret to 10 Million Concurrent Connections -The Kernel is the Problem, Not the Solution
20 0.56795883 1615 high scalability-2014-03-19-Strategy: Three Techniques to Survive Traffic Surges by Quickly Scaling Your Site
topicId topicWeight
[(1, 0.03), (2, 0.163), (10, 0.062), (30, 0.145), (61, 0.112), (75, 0.197), (77, 0.06), (79, 0.121)]
simIndex simValue blogId blogTitle
same-blog 1 0.83860391 312 high scalability-2008-04-30-Rather small site architecture.
Introduction: Website stats: Webserver: Apache 2.2 Database: MySQL 5.0 APC cache for php CMS: Drupal 6.2 (bleeding-edge version)* *Aggressive caching is ON, Page Compression ON, Block Cache ON (can't use CCS),Optimize CSS/JS ON. 2 Servers: Apache/Mysql (low-tech servers - Celeron processors, 512 MB RAM, 7200 RPM HDD) Bandwidth 10 Mb/s The benchmark: Used ab : ab -n 1000 -c 20 howwhatwho.com Server Software: Apache/2.2.3 Server Hostname: howwhatwho.com Server Port: 80 Document Path: / Document Length: 41639 bytes Concurrency Level: 20 Time taken for tests: 13.556796 seconds Complete requests: 1000 Failed requests: 0 Write errors: 0 Total transferred: 42118000 bytes HTML transferred: 41639000 bytes Requests per second: 73.76 [#/sec] (mean) Time per request: 271.136 [ms] (mean) Time per request: 13.557 [ms] (mean, across all concurrent requests) Transfer rate: 3033.90 [Kbytes/sec] received
2 0.83190703 1320 high scalability-2012-09-11-How big is a Petabyte, Exabyte, Zettabyte, or a Yottabyte?
Introduction: This is an intuitive look at large data sizes By Julian Bunn in Globally Interconnected Object Databases . Bytes(8 bits) 0.1 bytes: A binary decision 1 byte: A single character 10 bytes: A single word 100 bytes: A telegram OR A punched card Kilobyte (1000 bytes) 1 Kilobyte: A very short story 2 Kilobytes: A Typewritten page 10 Kilobytes: An encyclopaedic page OR A deck of punched cards 50 Kilobytes: A compressed document image page 100 Kilobytes: A low-resolution photograph 200 Kilobytes: A box of punched cards 500 Kilobytes: A very heavy box of punched cards Megabyte (1 000 000 bytes) 1 Megabyte: A small novel OR A 3.5 inch floppy disk 2 Megabytes: A high resolution photograph 5 Megabytes: The complete works of Shakespeare OR 30 seconds of TV-quality video 10 Megabytes: A minute of high-fidelity sound OR A digital chest X-ray 20 Megabytes: A box of floppy disks 50 Megabytes: A digital mammogram 100 Megabyte
3 0.77262604 831 high scalability-2010-05-26-End-To-End Performance Study of Cloud Services
Introduction: Cloud computing promises a number of advantages for the deployment of data-intensive applications. Most prominently, these include reducing cost with a pay-as-you-go pricing model and (virtually) unlimited throughput by adding servers if the workload increases. At the Systems Group , ETH Zurich, we did an extensive end-to-end performance study to compare the major cloud offerings regarding their ability to fulfill these promises and their implied cost. The focus of the work is on transaction processing (i.e., read and update work-loads), rather than analytics workloads. We used the TPC-W , a standardized benchmark simulating a Web-shop, as the baseline for our comparison. The TPC-W defines that users are simulated through emulated browsers (EB) and issue page requests, called web-interactions (WI), against the system. As a major modification to the benchmark, we constantly increase the load from 1 to 9000 simultaneous users to measure the scalability and cost variance of the syst
4 0.75974751 917 high scalability-2010-10-08-4 Scalability Themes from Surgecon
Introduction: Robert Haas in his SURGE Recap of the Surge conference, reflected a bit, and came up with an interesting checklist of general themes from what he was seeing. I'm directly quoting his post, so please see the post for a full discussion. He uses this framework to think about the larger picture and where PostgreSQL stands in its progression. Make use of the academic literature . Inventing your own way to do something is fine, but at least consider the possibility that someone smarter than you has thought about this problem before. Failures are inevitable, so plan for them . Try to minimize the possibility of cascading failures, and plan in advance how you can operate in degraded mode if disaster (or the Slashdot effect) strikes. Disk technology matters . Drive firmware bugs are common and nightmarish, and you can expect very limited help from the manufacturer, especially if the drive is billed as consumer-grade rather than enterprise-grade. SSDs can save you a lot of m
5 0.73884398 864 high scalability-2010-07-24-4 New Podcasts for Scalable Summertime Reading
Introduction: It's trendy today to say "I don't read blogs anymore, I just let the random chance of my social network guide me to new and interesting content." #fail. While someone says this I imagine them flicking their hair back in a "I can't be bothered with true understanding" disdain. And where does random chance get its content? From people like these. So: support your local blog! If you would like to be a part of random chance, here are a few new podcasts/blogs/vidcasts that you may not know about and that I've found interesting: DevOps Cafe . With this new video series where John and Damon visit high performing companies and record an insider's tour of the tools and processes those companies are using to solve their DevOps problems , DevOps is a profession that finally seems to be realizing their own value. In the first episode John Paul Ramirez takes the crew on a tour of Shopzilla's application lifecycle metrics and dashboard. The second episode feature John Allspaw, VP of
6 0.72855592 1459 high scalability-2013-05-16-Paper: Warp: Multi-Key Transactions for Key-Value Stores
7 0.72833163 361 high scalability-2008-08-08-Separation into read-write only databases
8 0.72248983 293 high scalability-2008-03-31-Read HighScalability on Your Mobile Phone Using WidSets Widgets
9 0.71896207 1173 high scalability-2012-01-12-Peregrine - A Map Reduce Framework for Iterative and Pipelined Jobs
10 0.7175566 261 high scalability-2008-02-25-Make Your Site Run 10 Times Faster
11 0.71660423 1552 high scalability-2013-11-22-Stuff The Internet Says On Scalability For November 22th, 2013
12 0.71473098 464 high scalability-2008-12-13-Strategy: Facebook Tweaks to Handle 6 Time as Many Memcached Requests
13 0.71058404 1183 high scalability-2012-01-30-37signals Still Happily Scaling on Moore RAM and SSDs
14 0.70639443 336 high scalability-2008-05-31-Biggest Under Reported Story: Google's BigTable Costs 10 Times Less than Amazon's SimpleDB
15 0.70634544 1337 high scalability-2012-10-10-Antirez: You Need to Think in Terms of Organizing Your Data for Fetching
16 0.70503485 890 high scalability-2010-09-01-Paper: The Case for Determinism in Database Systems
17 0.70307356 211 high scalability-2008-01-13-Google Reveals New MapReduce Stats
18 0.70221204 1291 high scalability-2012-07-25-Vertical Scaling Ascendant - How are SSDs Changing Architectures?
19 0.69861102 867 high scalability-2010-07-27-YeSQL: An Overview of the Various Query Semantics in the Post Only-SQL World
20 0.69681609 13 high scalability-2007-07-15-Lustre cluster file system