high_scalability high_scalability-2009 high_scalability-2009-528 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Lightcloud is a distributed and persistent key-value database from Plurk.com . Performance is said to be comparable to memcached. It's different than memcachedb because it scales out horizontally by adding new nodes. It's different than memcached because it persists to disk, it's not just a cache. Now you have one more option in the never ending quest to ditch the RDBMS. Their website does a nice job explaining the system: Built on Tokyo Tyrant. One of the fastest key-value databases [benchmark]. Tokyo Tyrant has been in development for many years and is used in production by Plurk.com, mixi.jp and scribd.com (to name a few)... Great performance (comparable to memcached!) Can store millions of keys on very few servers - tested in production Scale out by just adding nodes Nodes are replicated via master-master replication. Automatic failover and load balancing is supported from the start Ability to script and extend using Lua. Included extensions are i
sentIndex sentText sentNum sentScore
1 It's different than memcachedb because it scales out horizontally by adding new nodes. [sent-4, score-0.315]
2 It's different than memcached because it persists to disk, it's not just a cache. [sent-5, score-0.303]
3 Now you have one more option in the never ending quest to ditch the RDBMS. [sent-6, score-0.385]
4 Their website does a nice job explaining the system: Built on Tokyo Tyrant. [sent-7, score-0.157]
5 ) Can store millions of keys on very few servers - tested in production Scale out by just adding nodes Nodes are replicated via master-master replication. [sent-16, score-0.6]
6 Automatic failover and load balancing is supported from the start Ability to script and extend using Lua. [sent-17, score-0.417]
wordName wordTfidf (topN-words)
[('lightcloud', 0.534), ('backups', 0.271), ('comparable', 0.24), ('tokyo', 0.231), ('restore', 0.214), ('productionscale', 0.178), ('incr', 0.178), ('persists', 0.149), ('tyrant', 0.149), ('ditch', 0.145), ('print', 0.138), ('foot', 0.135), ('shutting', 0.126), ('manager', 0.125), ('extensions', 0.125), ('quest', 0.12), ('ending', 0.12), ('adding', 0.111), ('port', 0.104), ('included', 0.102), ('script', 0.102), ('memcached', 0.102), ('explaining', 0.1), ('nodes', 0.099), ('extend', 0.099), ('automatic', 0.091), ('horizontally', 0.089), ('tested', 0.087), ('fastest', 0.084), ('benchmark', 0.082), ('supported', 0.08), ('status', 0.079), ('keys', 0.078), ('failover', 0.077), ('fixed', 0.075), ('replicated', 0.074), ('lines', 0.074), ('languages', 0.072), ('python', 0.069), ('said', 0.068), ('name', 0.068), ('scales', 0.063), ('balancing', 0.059), ('nice', 0.057), ('take', 0.052), ('different', 0.052), ('client', 0.052), ('millions', 0.052), ('servers', 0.051), ('via', 0.048)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 528 high scalability-2009-03-06-Product: Lightcloud - Key-Value Database
Introduction: Lightcloud is a distributed and persistent key-value database from Plurk.com . Performance is said to be comparable to memcached. It's different than memcachedb because it scales out horizontally by adding new nodes. It's different than memcached because it persists to disk, it's not just a cache. Now you have one more option in the never ending quest to ditch the RDBMS. Their website does a nice job explaining the system: Built on Tokyo Tyrant. One of the fastest key-value databases [benchmark]. Tokyo Tyrant has been in development for many years and is used in production by Plurk.com, mixi.jp and scribd.com (to name a few)... Great performance (comparable to memcached!) Can store millions of keys on very few servers - tested in production Scale out by just adding nodes Nodes are replicated via master-master replication. Automatic failover and load balancing is supported from the start Ability to script and extend using Lua. Included extensions are i
Introduction: One of the world's leading technical institutes, the Tokyo Institute of Technology (Tokyo Tech) created the fastest supercomputer in Asia, and one of the largest outside of the United States. Using Sun x64 servers and data servers deployed in a grid architecture, Tokyo Tech built a cost-effective, flexible supercomputer that meets the demands of compute and data-intensive applications. Built in just 35 days, the TSUBAME grid includes hundreds of systems incorporating thousands of processor cores and terabytes of memory, and delivers 47.38 trillion floating-point operations per second (TeraFLOPS) of sustained LINPACK benchmark performance and 1.1 petabyte of storage to users running common off-the-shelf applications. Based on the deployment architecture, the grid is expected to reach 100 TeraFLOPS in the future. This article provides an overview of the Tokyo Tech grid, named TSUBAME. The first in a series of Sun BluePrints articles on the TSUBAME grid, this document discusses the re
3 0.11801717 545 high scalability-2009-03-19-Product: Redis - Not Just Another Key-Value Store
Introduction: With the introduction of Redis your options in the key-value space just grew and your choice of which to pick just got a lot harder. But when you think about it, that's not a bad position to be in at all. Redis (REmote DIctionary Server) - a key-value database. It's similar to memcached but the dataset is not volatile, and values can be strings, exactly like in memcached, but also lists and sets with atomic operations to push/pop elements. The key points are: open source; speed (benchmarked performing 110,000 SET operations, and 81,000 GETs, per second); persistence, but in an asynchronous way taking everything in memory; support for higher level data structures and atomic operations. The home page is well organized so I'll spare the excessive-copying-to-make-this-post-longer. For a good overview of Redis take a look at Antonio Cangiano's article: Introducing Redis: a fast key-value database . If you are looking at a way to understand how Redis is different than something like
4 0.11747157 695 high scalability-2009-09-06-Some Hot Links
Introduction: Key-Value System Benchmarks Vina Key-Value Store System Benchmark Redis vs MySQL vs Tokyo Tyrant (on EC2) Redis Benchmark Articles The Pathologies of Big Data Building Scalable Web Services High Performance Website How do I model a state? Let Me Count the Ways Presentation Even Faster Web sites Art of Parallelism Storage Systems for High Scalable Systems java on a 1000 Cores - Tales of Hardware / software CoDesign Random Database Optimization Patterns servers component how choice and build perfect server Understanding the processors Cache & Optimizing memory access amazon architecture Kngine Beta Kngine – Question Answer System
5 0.11463694 420 high scalability-2008-10-15-Tokyo Tech Tsubame Grid Storage Implementation
Introduction: This Sun BluePrint article describes the storage architecture of the Tokyo Institute of Technology TSUBAME grid. The Tokyo Institute of Technology is of the world's leading technical institutes, and recently created the fastest supercomputer in Asia, and one of the largest supercomputers outside of the United States. By deploying Sun Fire x64 servers and data servers in a grid architecture, Tokyo Tech built a cost-effective and flexible supercomputer consisting of hundreds of systems, thousands of processors, terabytes of memory and a petabyte of storage that supports users running common off-the-shelf applications. This is the second of a three-article series. It describes the steps to install and configuring the Lustre file system within the storage architecture.
6 0.10750603 1589 high scalability-2014-02-03-How Google Backs Up the Internet Along With Exabytes of Other Data
7 0.10739943 412 high scalability-2008-10-14-Sun N1 Grid Engine Software and the Tokyo Institute of Technology Super Computer Grid
8 0.10641805 881 high scalability-2010-08-16-Scaling an AWS infrastructure - Tools and Patterns
9 0.10107382 729 high scalability-2009-10-28-And the winner is: MySQL or Memcached or Tokyo Tyrant?
10 0.092279062 737 high scalability-2009-11-05-A Yes for a NoSQL Taxonomy
11 0.090620071 961 high scalability-2010-12-21-SQL + NoSQL = Yes !
12 0.081824288 1386 high scalability-2013-01-14-MongoDB and GridFS for Inter and Intra Datacenter Data Replication
13 0.077026375 1090 high scalability-2011-08-01-Peecho Architecture - scalability on a shoestring
14 0.07584919 360 high scalability-2008-08-04-A Bunch of Great Strategies for Using Memcached and MySQL Better Together
15 0.068708003 728 high scalability-2009-10-26-Facebook's Memcached Multiget Hole: More machines != More Capacity
16 0.063585721 691 high scalability-2009-08-31-Squarespace Architecture - A Grid Handles Hundreds of Millions of Requests a Month
17 0.063347928 920 high scalability-2010-10-15-Troubles with Sharding - What can we learn from the Foursquare Incident?
18 0.062270407 619 high scalability-2009-06-05-HotPads Shows the True Cost of Hosting on Amazon
19 0.060075462 670 high scalability-2009-08-05-Anti-RDBMS: A list of distributed key-value stores
20 0.059734806 353 high scalability-2008-07-20-Strategy: Front S3 with a Caching Proxy
topicId topicWeight
[(0, 0.095), (1, 0.025), (2, -0.011), (3, -0.046), (4, -0.002), (5, 0.047), (6, 0.025), (7, -0.052), (8, -0.017), (9, 0.009), (10, 0.006), (11, -0.003), (12, 0.03), (13, 0.014), (14, -0.01), (15, -0.001), (16, -0.011), (17, 0.008), (18, -0.045), (19, -0.017), (20, 0.008), (21, -0.037), (22, 0.039), (23, -0.021), (24, -0.032), (25, -0.034), (26, 0.038), (27, 0.032), (28, -0.064), (29, -0.045), (30, -0.015), (31, -0.023), (32, 0.011), (33, -0.024), (34, -0.006), (35, -0.044), (36, 0.012), (37, -0.023), (38, -0.005), (39, 0.01), (40, 0.002), (41, -0.03), (42, 0.038), (43, -0.025), (44, 0.023), (45, 0.018), (46, -0.005), (47, -0.009), (48, 0.026), (49, -0.013)]
simIndex simValue blogId blogTitle
same-blog 1 0.92517257 528 high scalability-2009-03-06-Product: Lightcloud - Key-Value Database
Introduction: Lightcloud is a distributed and persistent key-value database from Plurk.com . Performance is said to be comparable to memcached. It's different than memcachedb because it scales out horizontally by adding new nodes. It's different than memcached because it persists to disk, it's not just a cache. Now you have one more option in the never ending quest to ditch the RDBMS. Their website does a nice job explaining the system: Built on Tokyo Tyrant. One of the fastest key-value databases [benchmark]. Tokyo Tyrant has been in development for many years and is used in production by Plurk.com, mixi.jp and scribd.com (to name a few)... Great performance (comparable to memcached!) Can store millions of keys on very few servers - tested in production Scale out by just adding nodes Nodes are replicated via master-master replication. Automatic failover and load balancing is supported from the start Ability to script and extend using Lua. Included extensions are i
2 0.69635767 420 high scalability-2008-10-15-Tokyo Tech Tsubame Grid Storage Implementation
Introduction: This Sun BluePrint article describes the storage architecture of the Tokyo Institute of Technology TSUBAME grid. The Tokyo Institute of Technology is of the world's leading technical institutes, and recently created the fastest supercomputer in Asia, and one of the largest supercomputers outside of the United States. By deploying Sun Fire x64 servers and data servers in a grid architecture, Tokyo Tech built a cost-effective and flexible supercomputer consisting of hundreds of systems, thousands of processors, terabytes of memory and a petabyte of storage that supports users running common off-the-shelf applications. This is the second of a three-article series. It describes the steps to install and configuring the Lustre file system within the storage architecture.
Introduction: One of the world's leading technical institutes, the Tokyo Institute of Technology (Tokyo Tech) created the fastest supercomputer in Asia, and one of the largest outside of the United States. Using Sun x64 servers and data servers deployed in a grid architecture, Tokyo Tech built a cost-effective, flexible supercomputer that meets the demands of compute and data-intensive applications. Built in just 35 days, the TSUBAME grid includes hundreds of systems incorporating thousands of processor cores and terabytes of memory, and delivers 47.38 trillion floating-point operations per second (TeraFLOPS) of sustained LINPACK benchmark performance and 1.1 petabyte of storage to users running common off-the-shelf applications. Based on the deployment architecture, the grid is expected to reach 100 TeraFLOPS in the future. This article provides an overview of the Tokyo Tech grid, named TSUBAME. The first in a series of Sun BluePrints articles on the TSUBAME grid, this document discusses the re
Introduction: One of the world's leading technical institutes, the Tokyo Institute of Technology (Tokyo Tech) created the fastest supercomputer in Asia, and one of the largest outside of the United States. Using Sun x64 servers and data servers deployed in a grid architecture, Tokyo Tech built a cost-effective, flexible supercomputer that meets the demands of compute- and data-intensive applications. Built in just 35 days, the TSUBAME grid includes hundreds of systems incorporating thousands of processor cores and terabytes of memory, and delivers 47.38 trillion1 floating-point operations per second (TeraFLOPS) of sustained LINPACK benchmark performance and 1.1 petabyte of storage to users running common off-the-shelf applications. Based on the deployment architecture, the grid is expected to reach 100 TeraFLOPS in the future. This Sun BluePrints article provides an overview of the Tokyo Tech grid, named TSUBAME. The third in a series of Sun BluePrints articles on the TSUBAME grid, this document pro
5 0.66233897 545 high scalability-2009-03-19-Product: Redis - Not Just Another Key-Value Store
Introduction: With the introduction of Redis your options in the key-value space just grew and your choice of which to pick just got a lot harder. But when you think about it, that's not a bad position to be in at all. Redis (REmote DIctionary Server) - a key-value database. It's similar to memcached but the dataset is not volatile, and values can be strings, exactly like in memcached, but also lists and sets with atomic operations to push/pop elements. The key points are: open source; speed (benchmarked performing 110,000 SET operations, and 81,000 GETs, per second); persistence, but in an asynchronous way taking everything in memory; support for higher level data structures and atomic operations. The home page is well organized so I'll spare the excessive-copying-to-make-this-post-longer. For a good overview of Redis take a look at Antonio Cangiano's article: Introducing Redis: a fast key-value database . If you are looking at a way to understand how Redis is different than something like
6 0.64069635 103 high scalability-2007-09-28-Kosmos File System (KFS) is a New High End Google File System Option
7 0.61575538 696 high scalability-2009-09-07-Product: Infinispan - Open Source Data Grid
8 0.60840547 655 high scalability-2009-07-12-SPHiveDB: A mixture of the Key-Value Store and the Relational Database.
9 0.60370064 19 high scalability-2007-07-16-Paper: Replication Under Scalable Hashing
10 0.60151011 889 high scalability-2010-08-30-Pomegranate - Storing Billions and Billions of Tiny Little Files
11 0.59112847 373 high scalability-2008-08-29-Product: ScaleOut StateServer is Memcached on Steroids
12 0.56782383 396 high scalability-2008-09-26-Lucasfilm: The Real Magic is in the Data Center
13 0.56749749 72 high scalability-2007-08-22-Wikimedia architecture
14 0.56597602 308 high scalability-2008-04-22-Simple NFS failover solution with symbolic link?
15 0.56554925 695 high scalability-2009-09-06-Some Hot Links
16 0.56463921 1104 high scalability-2011-08-25-Colmux - Finding Memory Leaks, High I-O Wait Times, and Hotness on 3000 Node Clusters
17 0.56191134 1101 high scalability-2011-08-19-Stuff The Internet Says On Scalability For August 19, 2011
18 0.55608332 971 high scalability-2011-01-10-Riak's Bitcask - A Log-Structured Hash Table for Fast Key-Value Data
19 0.55320901 1340 high scalability-2012-10-15-Simpler, Cheaper, Faster: Playtomic's Move from .NET to Node and Heroku
20 0.55284423 542 high scalability-2009-03-17-IBM WebSphere eXtreme Scale (IMDG)
topicId topicWeight
[(1, 0.151), (2, 0.145), (10, 0.064), (40, 0.017), (56, 0.015), (79, 0.024), (85, 0.11), (92, 0.286), (94, 0.068)]
simIndex simValue blogId blogTitle
same-blog 1 0.80997032 528 high scalability-2009-03-06-Product: Lightcloud - Key-Value Database
Introduction: Lightcloud is a distributed and persistent key-value database from Plurk.com . Performance is said to be comparable to memcached. It's different than memcachedb because it scales out horizontally by adding new nodes. It's different than memcached because it persists to disk, it's not just a cache. Now you have one more option in the never ending quest to ditch the RDBMS. Their website does a nice job explaining the system: Built on Tokyo Tyrant. One of the fastest key-value databases [benchmark]. Tokyo Tyrant has been in development for many years and is used in production by Plurk.com, mixi.jp and scribd.com (to name a few)... Great performance (comparable to memcached!) Can store millions of keys on very few servers - tested in production Scale out by just adding nodes Nodes are replicated via master-master replication. Automatic failover and load balancing is supported from the start Ability to script and extend using Lua. Included extensions are i
2 0.78415859 1636 high scalability-2014-04-23-Here's a 1300 Year Old Solution to Resilience - Rebuild, Rebuild, Rebuild
Introduction: How is it possible that a wooden Shinto shrine built in the 7th century is still standing? The answer depends on how you answer this philosophical head scratcher: With nearly every cell in your body continually being replaced, are you still the same person? The Ise Grand Shrine has been in continuous existence for over 1300 years because every twenty years an exact replica has been rebuilt on an adjacent footprint. The former temple is then dismantled. Now that's resilience. If you want something to last make it a living part of a culture. It's not so much the building that is remade, what is rebuilt and passed down from generation to generation is the meme that the shrine is important and worth preserving. The rest is an unfolding of that imperative. You can see echoes of this same process in Open Source projects like Linux and the libraries and frameworks that get themselves reconstructed in each new environment. The patterns of recurrence in software are the result of Darw
Introduction: Alexey Radul in his fascinating 174 page dissertation Propagation Networks: A Flexible and Expressive Substrate for Computation , offers to help us break free of the tyranny of linear time by arranging computation as a network of autonomous but interconnected machines . We can do this by organizing computation as a network of interconnected machines of some kind, each of which is free to run when it pleases, propagating information around the network as proves possible. The consequence of this freedom is that the structure of the aggregate does not impose an order of time. The abstract from his thesis is : In this dissertation I propose a shift in the foundations of computation. Modern programming systems are not expressive enough. The traditional image of a single computer that has global effects on a large memory is too restrictive. The propagation paradigm replaces this with computing by networks of local, independent, stateless machines interconnected with stateful storage
4 0.73489511 352 high scalability-2008-07-18-Robert Scoble's Rules for Successfully Scaling Startups
Introduction: Robert Scoble in an often poignant FriendFeed thread commiserating PodTech's unfortunate end, shared what he learned about creating a successful startup. Here's a summary of a Robert's rules and why Machiavelli just may agree with them: Have a story. Have everyone on board with that story. If anyone goes off of that story, make sure they get on board immediately or fire them. Make sure people are judged by the revenues they bring in. Those that bring in revenues should get to run the place. People who don't bring in revenues should get fewer and fewer responsibilities, not more and more. Work ONLY for a leader who will make the tough decisions. Build a place where excellence is expected, allowed, and is enabled. Fire idiots quickly. If your engineering team can't give a media team good measurements, the entire company is in trouble. Only things that are measured ever get improved. When your stars aren't listened to the company is in trouble. Getting rid of t
5 0.71306562 1234 high scalability-2012-04-26-Akaros - an open source operating system for manycore architectures
Introduction: If you are interested in future foward OS designs then you might find Akaros worth a look. It's an operating system designed for many-core architectures and large-scale SMP systems, with the goals of: Providing better support for parallel and high-performance applications Scaling the operating system to a large number of cores A more indepth explanation of the motiviation behind Akaros can be found in Improving Per-Node Efficiency in the Datacenter with NewOS Abstractions by Barret Rhoden, Kevin Klues, David Zhu, and Eric Brewer. The abstract: We believe datacenters can benefit from more focus on per-node efficiency, performance, and predictability, versus the more common focus so far on scalability to a large number of nodes. Improving per-node efficiency decreases costs and fault recovery because fewer nodes are required for the same amount of work. We believe that the use of complex, general-purpose operating systems is a key contributing factor to these inefficiencies
6 0.71141005 988 high scalability-2011-02-11-Stuff The Internet Says On Scalability For February 11, 2011
7 0.65952444 928 high scalability-2010-10-26-Scaling DISQUS to 75 Million Comments and 17,000 RPS
8 0.65328723 140 high scalability-2007-11-02-How WordPress.com Tracks 300 Servers Handling 10 Million Pageviews
9 0.64864045 532 high scalability-2009-03-11-Sharding and Connection Pools
10 0.63066131 885 high scalability-2010-08-23-Building a Scalable Key-Value Database: Project Hydracus
11 0.61945629 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
12 0.61696339 157 high scalability-2007-11-16-Product: lbpool - Load Balancing JDBC Pool
13 0.61439633 357 high scalability-2008-07-26-Google's Paxos Made Live – An Engineering Perspective
14 0.60943329 1577 high scalability-2014-01-13-NYTimes Architecture: No Head, No Master, No Single Point of Failure
15 0.60871691 603 high scalability-2009-05-19-Scaling Memcached: 500,000+ Operations-Second with a Single-Socket UltraSPARC T2
16 0.60793513 1500 high scalability-2013-08-12-100 Curse Free Lessons from Gordon Ramsay on Building Great Software
17 0.6073153 1239 high scalability-2012-05-04-Stuff The Internet Says On Scalability For May 4, 2012
18 0.60570168 502 high scalability-2009-01-26-Paper: Scalability by Design - Coding for Systems With Large CPU Counts
19 0.60261977 1024 high scalability-2011-04-15-Stuff The Internet Says On Scalability For April 15, 2011
20 0.59906644 492 high scalability-2009-01-16-Database Sharding for startups