high_scalability high_scalability-2007 high_scalability-2007-74 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Varnish is a state-of-the-art, high-performance HTTP accelerator. Varnish is targeted primarily at the FreeBSD 6 and Linux 2.6 platforms, and will take full advantage of the virtual memory system and advanced I/O features offered by these operating systems. Varnish was written from the ground up to be a high performance caching reverse proxy. Squid is a forward proxy that can be configured as a reverse proxy. Besides - Squid is rather old and designed like computer programs where supposed to be designed in 1980. Varnish is reported to be 10x-20x faster than Squid on the same hardware.
sentIndex sentText sentNum sentScore
1 Varnish is targeted primarily at the FreeBSD 6 and Linux 2. [sent-2, score-0.292]
2 6 platforms, and will take full advantage of the virtual memory system and advanced I/O features offered by these operating systems. [sent-3, score-0.817]
3 Varnish was written from the ground up to be a high performance caching reverse proxy. [sent-4, score-0.656]
4 Squid is a forward proxy that can be configured as a reverse proxy. [sent-5, score-0.69]
5 Besides - Squid is rather old and designed like computer programs where supposed to be designed in 1980. [sent-6, score-0.89]
6 Varnish is reported to be 10x-20x faster than Squid on the same hardware. [sent-7, score-0.251]
wordName wordTfidf (topN-words)
[('squid', 0.574), ('reverse', 0.295), ('varnishis', 0.294), ('freebsd', 0.233), ('besides', 0.22), ('reported', 0.18), ('offered', 0.165), ('varnish', 0.165), ('supposed', 0.163), ('designed', 0.157), ('targeted', 0.155), ('proxy', 0.142), ('ground', 0.139), ('primarily', 0.137), ('forward', 0.134), ('programs', 0.125), ('advanced', 0.119), ('configured', 0.119), ('platforms', 0.116), ('operating', 0.095), ('advantage', 0.095), ('computer', 0.093), ('linux', 0.09), ('old', 0.088), ('rather', 0.082), ('virtual', 0.08), ('written', 0.079), ('faster', 0.071), ('caching', 0.068), ('full', 0.068), ('http', 0.066), ('features', 0.065), ('hardware', 0.064), ('memory', 0.057), ('take', 0.043), ('high', 0.041), ('performance', 0.034), ('system', 0.03), ('like', 0.025)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 74 high scalability-2007-08-23-Product: Varnish
Introduction: Varnish is a state-of-the-art, high-performance HTTP accelerator. Varnish is targeted primarily at the FreeBSD 6 and Linux 2.6 platforms, and will take full advantage of the virtual memory system and advanced I/O features offered by these operating systems. Varnish was written from the ground up to be a high performance caching reverse proxy. Squid is a forward proxy that can be configured as a reverse proxy. Besides - Squid is rather old and designed like computer programs where supposed to be designed in 1980. Varnish is reported to be 10x-20x faster than Squid on the same hardware.
2 0.2493183 662 high scalability-2009-07-27-Handle 700 Percent More Requests Using Squid and APC Cache
Introduction: This post on www.ilovebonnie.net documents some impressive system performance improvements by the addition of Squid Cache (a caching proxy) and APC Cache (opcode cache for PHP). Apache is able to deliver roughly 700% more requests per second with Squid when serving 1KB and 100KB images. Server load is reduced using Squid because the server does not have to create a bunch of Apache processes to handle the requests. APC Cache took a system that could barely handle 10-20 requests per second to handling 50-60 requests per second. A 400% increase. APC allowed the load times to remain under 5 seconds even with 200 concurrent threads slamming on the server. These two caches are easy to setup and install and allow you to get a lot more performance out of them. The post has an in-depth discussion and a number of supporting charts. The primary point is how simple it can be to improve performance and scalability by adding caching.
3 0.1801735 72 high scalability-2007-08-22-Wikimedia architecture
Introduction: Wikimedia is the platform on which Wikipedia, Wiktionary, and the other seven wiki dwarfs are built on. This document is just excellent for the student trying to scale the heights of giant websites. It is full of details and innovative ideas that have been proven on some of the most used websites on the internet. Site: http://wikimedia.org/ Information Sources Wikimedia architecture http://meta.wikimedia.org/wiki/Wikimedia_servers scale-out vs scale-up in the from Oracle to MySQL blog. Platform Apache Linux MySQL PHP Squid LVS Lucene for Search Memcached for Distributed Object Cache Lighttpd Image Server The Stats 8 million articles spread over hundreds of language projects (english, dutch, ...) 10th busiest site in the world (source: Alexa) Exponential growth: doubling every 4-6 months in terms of visitors / traffic / servers 30 000 HTTP requests/s during peak-time 3 Gbit/s of data traffic 3 data centers: Tampa, A
4 0.15572153 707 high scalability-2009-09-17-Hot Links for 2009-9-17
Introduction: Save 25% on Hadoop Conference Tickets Apache Hadoop is a hot technology getting traction all over the enterprise and in the Web 2.0 world. Now, there's going to be a conference dedicated to learning more about Hadoop. It'll be Friday, October 2 at the Roosevelt Hotel in New York City. Hadoop World, as it's being called, will be the first Hadoop event on the east coast. Morning sessions feature talks by Amazon, Cloudera, Facebook, IBM, and Yahoo! Then it breaks out into three tracks: applications, development / administration, and extensions / ecosystems. In addition to the conference itself, there will also be 3 days of training prior to the event for those looking to go deeper. In addition to general sessions speakers, presenters include Hadoop project creator Doug Cutting, as well as experts on large-scale data from Intel, Rackspace, Softplayer, eHarmony, Supermicro, Impetus, Booz Allen Hamilton, Vertica, About.com, and other companies. Readers get a 25% discount if you register b
5 0.13821399 248 high scalability-2008-02-13-What's your scalability plan?
Introduction: How do you plan to scale your system as you reach predictable milestones? This topic came up in another venue and it reminded me about a great comment an Anonymous wrote a while ago and I wanted to make sure that comment didn't get lost. The Anonymous scaling plan was relatively simple and direct: My two cents on what I'm using to start a website from scratch using a single server for now. Later, I'll scale out horizontally when the need arises. Phase 1 Single Server, Dual Quad-Core 2.66, 8gb RAM, 500gb Disk Raid 10 OS: Fedora 8. You could go with pretty much any Linux though. I like Fedora 8 best for servers. Proxy Cache: Varnish - it is way faster than Squid per my own benchmarks. Squid chokes bigtime. Web Server: Lighttpd - faster than Apache 2 and easier to configure for me. Object Cache: Memcached. Very scalable. PHP Cache: APC. Easy to configure and seems to work fine. Language: PHP 5 - no bloated frameworks, waste of time for me. You spend too mu
6 0.12931885 1321 high scalability-2012-09-12-Using Varnish for Paywalls: Moving Logic to the Edge
7 0.12607872 996 high scalability-2011-02-28-A Practical Guide to Varnish - Why Varnish Matters
8 0.11651344 134 high scalability-2007-10-26-Paper: Wikipedia's Site Internals, Configuration, Code Examples and Management Issues
9 0.11427921 456 high scalability-2008-12-01-Sun's High-Performance and Reliable Web Proxy Solution
10 0.10259272 172 high scalability-2007-12-02-nginx: high performance smpt-pop-imap proxy
11 0.099058107 152 high scalability-2007-11-13-Flickr Architecture
12 0.093344025 290 high scalability-2008-03-28-How to Get DNS Names of a Web Server
13 0.087432317 59 high scalability-2007-08-04-Try Squid as a Reverse Proxy
14 0.079369321 314 high scalability-2008-05-03-Product: nginx
15 0.075405426 5 high scalability-2007-07-10-mixi.jp Architecture
16 0.072784141 286 high scalability-2008-03-20-Paper: Asynchronous HTTP and Comet architectures
17 0.065178163 1177 high scalability-2012-01-19-Is it time to get rid of the Linux OS model in the cloud?
18 0.064034551 994 high scalability-2011-02-23-This stuff isn't taught, you learn it bit by bit as you solve each problem.
19 0.063438274 297 high scalability-2008-04-05-Skype Plans for PostgreSQL to Scale to 1 Billion Users
20 0.062399149 165 high scalability-2007-11-26-Scale to China
topicId topicWeight
[(0, 0.077), (1, 0.012), (2, -0.013), (3, -0.049), (4, -0.019), (5, 0.015), (6, 0.009), (7, -0.015), (8, -0.065), (9, 0.046), (10, -0.008), (11, -0.034), (12, 0.016), (13, 0.015), (14, -0.047), (15, -0.004), (16, -0.001), (17, 0.001), (18, -0.012), (19, 0.003), (20, -0.021), (21, 0.03), (22, -0.007), (23, -0.003), (24, -0.012), (25, 0.048), (26, 0.027), (27, 0.002), (28, -0.05), (29, 0.013), (30, -0.012), (31, 0.026), (32, -0.084), (33, 0.012), (34, 0.042), (35, 0.003), (36, -0.062), (37, 0.088), (38, 0.013), (39, 0.019), (40, -0.04), (41, 0.037), (42, 0.017), (43, -0.095), (44, 0.002), (45, 0.046), (46, -0.046), (47, -0.001), (48, 0.036), (49, 0.005)]
simIndex simValue blogId blogTitle
same-blog 1 0.95239872 74 high scalability-2007-08-23-Product: Varnish
Introduction: Varnish is a state-of-the-art, high-performance HTTP accelerator. Varnish is targeted primarily at the FreeBSD 6 and Linux 2.6 platforms, and will take full advantage of the virtual memory system and advanced I/O features offered by these operating systems. Varnish was written from the ground up to be a high performance caching reverse proxy. Squid is a forward proxy that can be configured as a reverse proxy. Besides - Squid is rather old and designed like computer programs where supposed to be designed in 1980. Varnish is reported to be 10x-20x faster than Squid on the same hardware.
2 0.6569227 314 high scalability-2008-05-03-Product: nginx
Introduction: Update 6 : nginx_http_push_module . Turn nginx into a long-polling message queuing HTTP push server. Update 5 : In Load Balancer Update Barry describes how WordPress.com moved from Pound to Nginx and are now "regularly serving about 8-9k requests/second and about 1.2Gbit/sec through a few Nginx instances and have plenty of room to grow!". Update 4 : Nginx better than Pound for load balancing. Pound spikes at 80% CPU, Nginx uses 3% and is easier to understand and better documented. Update 3 : igvita.com combines two cool tools together for better performance in Nginx and Memcached, a 400% boost! . Update 2 : Software Project on Installing Nginx Web Server w/ PHP and SSL . Breaking away from mother Apache can be a scary proposition and this kind of getting started article really helps easy the separation. Update: Slicehost has some nice tutorials on setting up Nginx . From their website: Nginx ("engine x") is a high-performance HTTP server and reverse proxy, as wel
3 0.6431995 996 high scalability-2011-02-28-A Practical Guide to Varnish - Why Varnish Matters
Introduction: This is a guest post by Jeff Su from Factual. What is Varnish? Varnish is an open source, high performance http accelerator that sits in front of a web stack and caches pages. This caching layer is very configurable and can be used for both static and dynamic content. One great thing about Varnish is that it can improve the performance of your website without requiring any code changes. If you haven’t heard of Varnish (or have heard of it, but haven’t used it), please read on. Adding Varnish to your stack can be completely noninvasive, but if you tweak your stack to play along with some of varnish’s more advanced features, you’ll be able to increase performance by orders of magnitude. Some of the high profile companies using Varnish include: Twitter , Facebook , Heroku and LinkedIn . Our Use Case One of Factual’s first high profile projects was Newsweek’s “America’s Best High Schools: The List” . After realizing that we had only a few weeks to increase our
4 0.62623936 662 high scalability-2009-07-27-Handle 700 Percent More Requests Using Squid and APC Cache
Introduction: This post on www.ilovebonnie.net documents some impressive system performance improvements by the addition of Squid Cache (a caching proxy) and APC Cache (opcode cache for PHP). Apache is able to deliver roughly 700% more requests per second with Squid when serving 1KB and 100KB images. Server load is reduced using Squid because the server does not have to create a bunch of Apache processes to handle the requests. APC Cache took a system that could barely handle 10-20 requests per second to handling 50-60 requests per second. A 400% increase. APC allowed the load times to remain under 5 seconds even with 200 concurrent threads slamming on the server. These two caches are easy to setup and install and allow you to get a lot more performance out of them. The post has an in-depth discussion and a number of supporting charts. The primary point is how simple it can be to improve performance and scalability by adding caching.
5 0.61134142 172 high scalability-2007-12-02-nginx: high performance smpt-pop-imap proxy
Introduction: nginx is a high performance smtp/pop/imap proxy that lets you do custom authorization and lookups and is very scalable. (just add nodes) Nginx by default is a reverse proxy and this is what it is doing here for pop/imap connections. It is also an excellelent reverse proxy for web servers. Advantage: You dont have to have a speacial database or ldap schema. Just an url to do auth and lookup with. A url that may be accessed by a unix or a tcp socket. Write your own auth handler - according to your own policy. For example: A user called atif tries to login with the pass testxyz. You pass this infomation to a URL such as socket:/var/tmp/xyz.sock or http://auth.corp.mailserver.net:someport/someurl The auth server replies with either a FAILURE such as Auth-Status: Invalid Login or password or with a success such as Auth-Status: OK Auth-Server: OneOfThe100Servers Auth-Port: optionalyAPort We have implemented it at our ISP and it has saves us a
7 0.53352702 914 high scalability-2010-10-04-Paper: An Analysis of Linux Scalability to Many Cores
8 0.5221132 29 high scalability-2007-07-25-Product: lighttpd
9 0.51546925 708 high scalability-2009-09-17-Infinispan narrows the gap between open source and commercial data caches
10 0.50829184 230 high scalability-2008-01-29-Speed up (Oracle) database code with result caching
11 0.50686365 248 high scalability-2008-02-13-What's your scalability plan?
12 0.49501765 164 high scalability-2007-11-22-Why not Cache from Intersystems?
14 0.48719466 603 high scalability-2009-05-19-Scaling Memcached: 500,000+ Operations-Second with a Single-Socket UltraSPARC T2
15 0.48628727 998 high scalability-2011-03-03-Stack Overflow Architecture Update - Now at 95 Million Page Views a Month
16 0.48085904 1346 high scalability-2012-10-24-Saving Cash Using Less Cache - 90% Savings in the Caching Tier
17 0.47841033 1321 high scalability-2012-09-12-Using Varnish for Paywalls: Moving Logic to the Edge
18 0.47732955 467 high scalability-2008-12-16-[ANN] New Open Source Cache System
19 0.47598121 707 high scalability-2009-09-17-Hot Links for 2009-9-17
20 0.4727211 1594 high scalability-2014-02-12-Paper: Network Stack Specialization for Performance
topicId topicWeight
[(1, 0.21), (2, 0.168), (23, 0.417), (79, 0.043)]
simIndex simValue blogId blogTitle
Introduction: Summary In this presentation, a three steps approach for turning your existing stateful tier-based/Spring-application into a dynamically scalable services application using OpenSpaces is demonstrated. The existing programming model is kept the same while focusing on abstracting and replacing the underlying implementations of the middleware stack in a way that will fit the scale-out model. Bio Nati Shalom is the CTO and Founder of GigaSpaces and responsible for the technology roadmap. He has 10 years of experience with distributed technology and architecture namely CORBA, Jini, J2EE, Grid and SOA. Nati is the Head of the Israeli Grid consortium and an evangelist of Space Based Architecture and Data Grid patterns. Blog: Gigaspaces Blog Read the rest of the article here on InfoQ .
same-blog 2 0.88905108 74 high scalability-2007-08-23-Product: Varnish
Introduction: Varnish is a state-of-the-art, high-performance HTTP accelerator. Varnish is targeted primarily at the FreeBSD 6 and Linux 2.6 platforms, and will take full advantage of the virtual memory system and advanced I/O features offered by these operating systems. Varnish was written from the ground up to be a high performance caching reverse proxy. Squid is a forward proxy that can be configured as a reverse proxy. Besides - Squid is rather old and designed like computer programs where supposed to be designed in 1980. Varnish is reported to be 10x-20x faster than Squid on the same hardware.
3 0.82792425 669 high scalability-2009-08-03-Building a Data Intensive Web Application with Cloudera, Hadoop, Hive, Pig, and EC2
Introduction: This tutorial will show you how to use Amazon EC2 and Cloudera's Distribution for Hadoop to run batch jobs for a data intensive web application. During the tutorial, we will perform the following data processing steps.... read more on Cloudera website
4 0.70841241 548 high scalability-2009-03-25-Advertising
Introduction: Advertising Opportunities on High Scalability Premium Advertisers: High Scalability Premium Advertisements are the graphical advertisements located on the left side of the page. We currently have a limit of four premium spots for both the blog and forums. For current ad rates, please contact us at via our contact us page. Premium Advertiser Rules: * One of four advertisements on the left * Ad will receive 100% share of page impressions of either the blog or forum section * Ad creative is 125 x 125 pixels * 8K file size limit * No animation or flash ads * We ask for the ads to not be too distracting from the content Current Availability: There are ad slots available at this time, feel free to contact us for more information on ad rates and traffic data.
5 0.68716913 979 high scalability-2011-01-27-Comet - An Example of the New Key-Code Databases
Introduction: Comet is an active distributed key-value store built at the University of Washington. The paper describing Comet is Comet: An active distributed key-value store , there are also slides , and a MP3 of a presentation given at OSDI '10 . Here's a succinct overview of Comet : Today's cloud storage services, such as Amazon S3 or peer-to-peer DHTs, are highly inflexible and impose a variety of constraints on their clients: specific replication and consistency schemes, fixed data timeouts, limited logging, etc. We witnessed such inflexibility first-hand as part of our Vanish work, where we used a DHT to store encryption keys temporarily. To address this issue, we built Comet, an extensible storage service that allows clients to inject snippets of code that control their data's behavior inside the storage service. I found this paper quite interesting because it takes the initial steps of collocating code with a key-value store, which turns it into what might called a key-code
7 0.6494922 1105 high scalability-2011-08-25-The Cloud and The Consumer: The Impact on Bandwidth and Broadband
9 0.62299746 1529 high scalability-2013-10-08-F1 and Spanner Holistically Compared
10 0.62182343 654 high scalability-2009-07-09-No to SQL? Anti-database movement gains steam – My Take
13 0.61588639 990 high scalability-2011-02-15-Wordnik - 10 million API Requests a Day on MongoDB and Scala
15 0.61071235 7 high scalability-2007-07-12-FeedBurner Architecture