high_scalability high_scalability-2010 high_scalability-2010-927 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Memcached is one of the most common In-Memory cache implementation. It was originally developed by Danga Interactive for LiveJournal , but is now used by many other sites as a side cache to speed up read mostly operations. It gained popularity in the non-Java world, too, especially since it’s a language-neutral side cache for which few alternatives existed. As a side-cache, Memcache clients relies on the database as the system of record, The database is still used for write,update and complex query operations. Since the memcached specification includes no query operations, memcached is not a database alternative, unlike most of the NoSQL offerings. It also exclude memcache from being a real solution for write scalability. As a result of that many of the heavy sites started to move away from Memcache and replace it with other NoSQL alternatives as noted in a recent highscalability post MySQL And Memcached: End Of An Era? The transition away from memcached to NoSQL
sentIndex sentText sentNum sentScore
1 Memcached is one of the most common In-Memory cache implementation. [sent-1, score-0.126]
2 It was originally developed by Danga Interactive for LiveJournal , but is now used by many other sites as a side cache to speed up read mostly operations. [sent-2, score-0.659]
3 It gained popularity in the non-Java world, too, especially since it’s a language-neutral side cache for which few alternatives existed. [sent-3, score-0.799]
4 As a side-cache, Memcache clients relies on the database as the system of record, The database is still used for write,update and complex query operations. [sent-4, score-0.233]
5 Since the memcached specification includes no query operations, memcached is not a database alternative, unlike most of the NoSQL offerings. [sent-5, score-1.134]
6 It also exclude memcache from being a real solution for write scalability. [sent-6, score-0.586]
7 As a result of that many of the heavy sites started to move away from Memcache and replace it with other NoSQL alternatives as noted in a recent highscalability post MySQL And Memcached: End Of An Era? [sent-7, score-0.927]
8 The transition away from memcached to NoSQL could represent a large investment as many sites are already heavily invested in memcached usage. [sent-8, score-1.606]
9 In this post, I'll illustrate an alternative approach in which we’ll extend the use of memcache for write scaling, add other goodies such as high availability and elasticity by plugging GigaSpaces as the backend datastore, and avoid the need for a re-write. [sent-9, score-1.239]
10 The pure Java implementation could also be seen as a benefit as it can increase the adoption of memcached within the Java community and leverage the portability of java to other platforms. [sent-10, score-1.0]
wordName wordTfidf (topN-words)
[('memcached', 0.37), ('memcache', 0.32), ('alternatives', 0.22), ('exclude', 0.184), ('plugging', 0.173), ('sites', 0.169), ('goodies', 0.159), ('alternative', 0.158), ('nosql', 0.15), ('neutral', 0.146), ('livejournal', 0.14), ('gained', 0.14), ('java', 0.139), ('portability', 0.138), ('noted', 0.131), ('illustrate', 0.131), ('invested', 0.127), ('relies', 0.127), ('cache', 0.126), ('side', 0.115), ('specification', 0.115), ('elasticity', 0.114), ('represent', 0.108), ('query', 0.106), ('away', 0.104), ('originally', 0.104), ('extend', 0.102), ('datastore', 0.101), ('investment', 0.1), ('since', 0.099), ('popularity', 0.099), ('unlike', 0.098), ('era', 0.097), ('gigaspaces', 0.095), ('adoption', 0.094), ('heavily', 0.094), ('transition', 0.094), ('pure', 0.092), ('replace', 0.088), ('leverage', 0.086), ('interactive', 0.085), ('write', 0.082), ('benefit', 0.081), ('record', 0.078), ('includes', 0.075), ('mostly', 0.075), ('post', 0.074), ('heavy', 0.073), ('recent', 0.072), ('many', 0.07)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999976 927 high scalability-2010-10-26-Marrying memcached and NoSQL
Introduction: Memcached is one of the most common In-Memory cache implementation. It was originally developed by Danga Interactive for LiveJournal , but is now used by many other sites as a side cache to speed up read mostly operations. It gained popularity in the non-Java world, too, especially since it’s a language-neutral side cache for which few alternatives existed. As a side-cache, Memcache clients relies on the database as the system of record, The database is still used for write,update and complex query operations. Since the memcached specification includes no query operations, memcached is not a database alternative, unlike most of the NoSQL offerings. It also exclude memcache from being a real solution for write scalability. As a result of that many of the heavy sites started to move away from Memcache and replace it with other NoSQL alternatives as noted in a recent highscalability post MySQL And Memcached: End Of An Era? The transition away from memcached to NoSQL
2 0.27932578 360 high scalability-2008-08-04-A Bunch of Great Strategies for Using Memcached and MySQL Better Together
Introduction: The primero recommendation for speeding up a website is almost always to add cache and more cache. And after that add a little more cache just in case. Memcached is almost always given as the recommended cache to use. What we don't often hear is how to effectively use a cache in our own products. MySQL hosted two excellent webinars (referenced below) on the subject of how to deploy and use memcached. The star of the show, other than MySQL of course, is Farhan Mashraqi of Fotolog. You may recall we did an earlier article on Fotolog in Secrets to Fotolog's Scaling Success , which was one of my personal favorites. Fotolog, as they themselves point out, is probably the largest site nobody has ever heard of, pulling in more page views than even Flickr. Fotolog has 51 instances of memcached on 21 servers with 175G in use and 254G available. As a large successful photo-blogging site they have very demanding performance and scaling requirements. To meet those requirements they've developed a
Introduction: While working with Memcache the other night, it dawned on me that it’s usage as a distributed caching mechanism was really just one of many ways to use it. That there are in fact many alternative usages that one could find for Memcache if they could just realize what Memcache really is at its core – a simple distributed hash-table – is an important point worthy of further discussion. To be clear, when I say “simple”, by no means am I implying that Memcache’s implementation is simple, just that the ideas behind it are such. Think about that for a minute. What else could we use a simple distributed hash-table for, besides caching? How about using it as an alternative to the traditional shard lookup method we used in our Master Index Lookup scalability strategy, discussed previously here.
4 0.19583477 785 high scalability-2010-02-26-MySQL and Memcached: End of an Era?
Introduction: If you look at the early days of this blog, when web scalability was still in its heady bloom of youth, many of the articles had to do with leveraging MySQL and memcached . Exciting times. Shard MySQL to handle high write loads, cache objects in memcached to handle high read loads, and then write a lot of glue code to make it all work together. That was state of the art, that was how it was done. The architecture of many major sites still follow this pattern today, largely because with enough elbow grease, it works. This was a pre-cloud, relational database dominated world, built from parts scrounged from the remnants of enterprises and datacenters past. Twitter and Digg started in this era, but are evolving into something different, as scaling pressures increase and new purpose built technologies pop into being. With a little perspective, it's clear the MySQL+memcached era is passing. It will stick around for a while. Old technologies seldom fade away completely. Some still
5 0.19463113 729 high scalability-2009-10-28-And the winner is: MySQL or Memcached or Tokyo Tyrant?
Introduction: Matt, from the ever excellent MySQL Performance Blog , decided to run a test using a simple scenario drawn from his client experience in the gaming space. The scenario: read a row based on a primary key, update the row, write it to disk, and use the row to lookup another row. Matt ran three different tests explained in a series of three different articles: MySQL and MySQL + Memcached, Memcached Only , and Tokyo Tyrant . The lovingly compiled details along with many cool graphs are in the articles, but in general the lessons learned are: When memcached has enough memory (so records being accessed are in RAM), memcached + MySQL can provide a 10x performance boost over MySQL alone. When the RAM is too small and hot records, those being accessed a lot, aren't in RAM, or perhaps applications are doing a sequential scan of a table and the entire table isn't cached, then memcached won't be the big bang improvement you may be hoping for. When the database is removed and memcac
6 0.16495167 577 high scalability-2009-04-22-Gear6 Web cache - the hardware solution for working with Memcache
7 0.15576445 52 high scalability-2007-08-01-Product: Memcached
8 0.13973355 1144 high scalability-2011-11-17-Five Misconceptions on Cloud Portability
9 0.1323455 294 high scalability-2008-04-01-How to update video views count effectively?
10 0.13184772 749 high scalability-2009-12-15-The Common Principles Behind the NOSQL Alternatives
11 0.12651107 1135 high scalability-2011-10-31-15 Ways to Make Your Application Feel More Responsive under Google App Engine
12 0.12634437 192 high scalability-2007-12-25-IBMer Says LAMP Can't Scale
13 0.12341921 1126 high scalability-2011-09-27-Use Instance Caches to Save Money: Latency == $$$
14 0.12034574 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
15 0.11825812 961 high scalability-2010-12-21-SQL + NoSQL = Yes !
16 0.11646185 459 high scalability-2008-12-03-Java World Interview on Scalability and Other Java Scalability Secrets
17 0.11625798 776 high scalability-2010-02-12-Hot Scalability Links for February 12, 2010
18 0.11240417 367 high scalability-2008-08-17-Strategy: Drop Memcached, Add More MySQL Servers
19 0.11214031 603 high scalability-2009-05-19-Scaling Memcached: 500,000+ Operations-Second with a Single-Socket UltraSPARC T2
20 0.11108165 373 high scalability-2008-08-29-Product: ScaleOut StateServer is Memcached on Steroids
topicId topicWeight
[(0, 0.152), (1, 0.057), (2, -0.039), (3, -0.079), (4, 0.048), (5, 0.123), (6, -0.063), (7, -0.082), (8, -0.013), (9, -0.022), (10, -0.033), (11, -0.003), (12, -0.006), (13, 0.114), (14, -0.071), (15, -0.083), (16, -0.013), (17, -0.076), (18, 0.029), (19, -0.062), (20, -0.062), (21, 0.005), (22, 0.053), (23, 0.047), (24, 0.024), (25, 0.034), (26, 0.005), (27, 0.0), (28, -0.015), (29, -0.069), (30, 0.0), (31, 0.01), (32, -0.032), (33, -0.06), (34, -0.033), (35, 0.006), (36, -0.026), (37, -0.054), (38, 0.081), (39, 0.013), (40, 0.103), (41, 0.089), (42, -0.067), (43, -0.033), (44, -0.029), (45, -0.046), (46, 0.025), (47, -0.034), (48, 0.012), (49, -0.056)]
simIndex simValue blogId blogTitle
same-blog 1 0.98201782 927 high scalability-2010-10-26-Marrying memcached and NoSQL
Introduction: Memcached is one of the most common In-Memory cache implementation. It was originally developed by Danga Interactive for LiveJournal , but is now used by many other sites as a side cache to speed up read mostly operations. It gained popularity in the non-Java world, too, especially since it’s a language-neutral side cache for which few alternatives existed. As a side-cache, Memcache clients relies on the database as the system of record, The database is still used for write,update and complex query operations. Since the memcached specification includes no query operations, memcached is not a database alternative, unlike most of the NoSQL offerings. It also exclude memcache from being a real solution for write scalability. As a result of that many of the heavy sites started to move away from Memcache and replace it with other NoSQL alternatives as noted in a recent highscalability post MySQL And Memcached: End Of An Era? The transition away from memcached to NoSQL
2 0.78457165 360 high scalability-2008-08-04-A Bunch of Great Strategies for Using Memcached and MySQL Better Together
Introduction: The primero recommendation for speeding up a website is almost always to add cache and more cache. And after that add a little more cache just in case. Memcached is almost always given as the recommended cache to use. What we don't often hear is how to effectively use a cache in our own products. MySQL hosted two excellent webinars (referenced below) on the subject of how to deploy and use memcached. The star of the show, other than MySQL of course, is Farhan Mashraqi of Fotolog. You may recall we did an earlier article on Fotolog in Secrets to Fotolog's Scaling Success , which was one of my personal favorites. Fotolog, as they themselves point out, is probably the largest site nobody has ever heard of, pulling in more page views than even Flickr. Fotolog has 51 instances of memcached on 21 servers with 175G in use and 254G available. As a large successful photo-blogging site they have very demanding performance and scaling requirements. To meet those requirements they've developed a
3 0.73457402 149 high scalability-2007-11-12-Scaling Using Cache Farms and Read Pooling
Introduction: Michael Nygard talks about Two Ways To Boost Your Flagging Web Site . The idea behind cache farms is to move memory devoted to the various caching layers into one large farm of caches, as with memcached. The idea behind read pools is to allocate your database read requests to a pool of dedicated read servers, thus offloading the write server. Using a combination of the strategies you aren't forced to scale up the database tier to scale your website.
4 0.7076236 436 high scalability-2008-11-02-Strategy: How to Manage Sessions Using Memcached
Introduction: Dormando shows an enlightened middle way for storing sessions in cache and the database. Sessions are a perfect cache candidate because they are transient, smallish, and since they are usually accessed on every page access removing all that load from the database is a good thing. But as Dormando points out session caches have problems. If you remove expiration times from the cache and you run out of memory then no more logins. If a cache server fails or needs to be upgrade then you just logged out a bunch of potentially angry users. The middle ground Dormando proposes is using both the cache and the database: Reads : read from the cache first, then the database. Typical cache logic. Writes : write to memcached every time, write to the database every N seconds (assuming the data has changed). There's a small chance of data loss, but you've still greatly reduced the database load while providing reliability. Nice solution.
5 0.70236105 673 high scalability-2009-08-07-Strategy: Break Up the Memcache Dog Pile
Introduction: Update: Asynchronous HTTP cache validations . A proposed HTTP caching extension: if your application can afford to show slightly out of date content, then stale-while-revalidate can guarantee that the user will always be served directly from the cache, hence guaranteeing a consistent response-time user-experience. Caching is like aspirin for headaches. Head hurts: pop a 'sprin. Slow site: add caching. Facebook must have a lot of headaches because they popped 805 memcached servers between 10,000 web servers and 1,800 MySQL servers and they reportedly have a 99% cache hit rate. But what's the best way for you to cache for your application? It's a remarkably complex and rich topic. Alexey Kovyrin talks about one common caching problem called the Dog Pile Effect in Dog-pile Effect and How to Avoid it with Ruby on Rails . Glenn Franxman also has a Django solution in MintCache . Data is usually cached because it's too expensive to calculate for every hit. Maybe it's a gnarly S
6 0.70200092 729 high scalability-2009-10-28-And the winner is: MySQL or Memcached or Tokyo Tyrant?
7 0.69764709 785 high scalability-2010-02-26-MySQL and Memcached: End of an Era?
8 0.68634444 367 high scalability-2008-08-17-Strategy: Drop Memcached, Add More MySQL Servers
9 0.68470687 602 high scalability-2009-05-17-Scaling Django Web Apps by Mike Malone
10 0.67980433 911 high scalability-2010-09-30-More Troubles with Caching
11 0.66954809 577 high scalability-2009-04-22-Gear6 Web cache - the hardware solution for working with Memcache
12 0.66942376 192 high scalability-2007-12-25-IBMer Says LAMP Can't Scale
13 0.65314215 174 high scalability-2007-12-05-Product: Tugela Cache
14 0.64857465 495 high scalability-2009-01-17-Intro to Caching,Caching algorithms and caching frameworks part 1
15 0.64261115 247 high scalability-2008-02-12-We want to cache a lot :) How do we go about it ?
16 0.63678366 248 high scalability-2008-02-13-What's your scalability plan?
17 0.63604027 708 high scalability-2009-09-17-Infinispan narrows the gap between open source and commercial data caches
18 0.62425339 1633 high scalability-2014-04-16-Six Lessons Learned the Hard Way About Scaling a Million User System
19 0.62247849 191 high scalability-2007-12-23-Synchronizing Memcached application
20 0.6204372 1346 high scalability-2012-10-24-Saving Cash Using Less Cache - 90% Savings in the Caching Tier
topicId topicWeight
[(1, 0.136), (2, 0.227), (10, 0.036), (40, 0.042), (44, 0.165), (57, 0.016), (61, 0.058), (79, 0.137), (94, 0.08)]
simIndex simValue blogId blogTitle
1 0.93198931 366 high scalability-2008-08-17-Many updates against MySQL
Introduction: Hello! My first post here, so be patient please. I am developing site where I have lots of static content. But on many pages I have query to update count of views. I would say this is may cause lots of problems and was interested in another solution like storing these counts somewhere else. As my knowledge is bit limited in this way, I am asking you. I can say I understand PHP(OOP ofc) and MySQL. Nowadays I am getting into servers. Other question I have is: I read about making lots of things static.(in Flickr Architecture) and am interested how they do static sites? Lets say they make photo page static? And rebuild when tagg or comment is added? I am bit interested in it as I want to learn Smarty better(newbie) and serving content. Moreover, how about PHP? I have read many books about PHP theoretically but would love to see some RL example of using objects and exceptions(mainly this as I don't completely understand it) to learn some good programming habits. So if you can help
2 0.91616881 817 high scalability-2010-04-29-Product: SciDB - A Science-Oriented DBMS at 100 Petabytes
Introduction: Scientists are doing it for themselves. Doing what? Databases. The idea is that most databases are designed to meet the needs of businesses, not science, so scientists are banding together at scidb.org to create their own Domain Specific Database, for science. The goal is to be able to handle datasets in the 100PB range and larger. SciDB, Inc. is building an open source database technology product designed specifically to satisfy the demands of data-intensive scientific problems. With the advice of the world's leading scientists across a variety of disciplines including astronomy, biology, physics, oceanography, atmospheric sciences, and climatology, our computer scientists are currently designing and prototyping this technology The scientists that are participating in our open source project believe that the SciDB database — when completed — will dramatically impact their ability to conduct their experiments faster and more efficiently and further improve the qual
same-blog 3 0.90564597 927 high scalability-2010-10-26-Marrying memcached and NoSQL
Introduction: Memcached is one of the most common In-Memory cache implementation. It was originally developed by Danga Interactive for LiveJournal , but is now used by many other sites as a side cache to speed up read mostly operations. It gained popularity in the non-Java world, too, especially since it’s a language-neutral side cache for which few alternatives existed. As a side-cache, Memcache clients relies on the database as the system of record, The database is still used for write,update and complex query operations. Since the memcached specification includes no query operations, memcached is not a database alternative, unlike most of the NoSQL offerings. It also exclude memcache from being a real solution for write scalability. As a result of that many of the heavy sites started to move away from Memcache and replace it with other NoSQL alternatives as noted in a recent highscalability post MySQL And Memcached: End Of An Era? The transition away from memcached to NoSQL
4 0.90400302 660 high scalability-2009-07-21-Paper: Parallelizing the Web Browser
Introduction: There have been reports that software engineering is dead . Maybe, like the future, software engineering is simply not evenly distributed? When you read this paper I think you'll agree there is some real engineering going on, it's just that most of the things we need to build do not require real engineering. Much like my old childhood tree fort could be patched together and was "good enough." This brings to mind the old joke: If a software tree falls in the woods would anyone hear it fall? Only if it tweeted on the way down... What this paper really showed me is we need not only to change programming practices and constructs, but we also need to design solutions that allow for deep parallelism to begin with. Grafting parallelism on later is difficult. Parallel execution requires knowing precisely how components are dependent on each other and that level of precision tends to go far beyond the human attention span. In particular this paper deals with how to parallelize the browser on
5 0.88148093 1177 high scalability-2012-01-19-Is it time to get rid of the Linux OS model in the cloud?
Introduction: You program in a dynamic language, that runs on a JVM, that runs on a OS designed 40 years ago for a completely different purpose, that runs on virtualized hardware. Does this make sense? We've talked about this idea before in Machine VM + Cloud API - Rewriting The Cloud From Scratch , where the vision is to treat cloud virtual hardware as a compiler target, and converting high-level language source code directly into kernels that run on it. As new technologies evolve the friction created by our old tool chains and architecture models becomes ever more obvious. Take, for example, what a team at UCSD is releasing: a phase-change memory prototype - a solid state storage device that provides performance thousands of times faster than a conventional hard drive and up to seven times faster than current state-of-the-art solid-state drives (SSDs). However, PCM has access latencies several times slower than DRAM. This technology has obvious mind blowing implications, but an
6 0.88140804 847 high scalability-2010-06-23-Product: dbShards - Share Nothing. Shard Everything.
7 0.87824196 636 high scalability-2009-06-23-Learn How to Exploit Multiple Cores for Better Performance and Scalability
8 0.87476754 517 high scalability-2009-02-21-Google AppEngine - A Second Look
9 0.87051892 1649 high scalability-2014-05-16-Stuff The Internet Says On Scalability For May 16th, 2014
10 0.86943543 1612 high scalability-2014-03-14-Stuff The Internet Says On Scalability For March 14th, 2014
11 0.86941379 789 high scalability-2010-03-05-Strategy: Planning for a Power Outage Google Style
12 0.86894423 301 high scalability-2008-04-08-Google AppEngine - A First Look
13 0.86769092 1516 high scalability-2013-09-13-Stuff The Internet Says On Scalability For September 13, 2013
14 0.86706948 1233 high scalability-2012-04-25-The Anatomy of Search Technology: blekko’s NoSQL database
15 0.86660928 837 high scalability-2010-06-07-Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users
16 0.86568034 229 high scalability-2008-01-29-Building scalable storage into application - Instead of MogileFS OpenAFS etc.
17 0.86549067 1404 high scalability-2013-02-11-At Scale Even Little Wins Pay Off Big - Google and Facebook Examples
18 0.86532009 1589 high scalability-2014-02-03-How Google Backs Up the Internet Along With Exabytes of Other Data
19 0.86530858 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
20 0.86528176 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture