high_scalability high_scalability-2009 high_scalability-2009-498 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Update 35 : How and Why Glue is Using Amazon SimpleDB instead of a Relational Database . Discusses a key design decision that required duplicating data in order to mimic RDBMS joins: Given the trade off between potential inconsistencies and scalability, social services have to choose the latter. Update 34 : Apparently Amazon pulled this article. I'm not sure what that means. Maybe time went backwards or something? Amazon dramatically drops SimpleDB pricing to $0.25 per GB per month from $1.50 per GB . This puts SimpleDB on par with Google App Engine . They also announced a few new features: a SQL-like SELECT API as well as a Batch Put operation to streamline uploading of multiple items or attributes . One of the complaints against SimpleDB is that programmers end up writing too much code to do simple things. These features and a much cheaper price should help considerably. And you can store lots of data now. GAE is still capped. Update 33 : Amazon announces
sentIndex sentText sentNum sentScore
1 They also announced a few new features: a SQL-like SELECT API as well as a Batch Put operation to streamline uploading of multiple items or attributes . [sent-10, score-0.149]
2 Update 32 : You can now get all attributes for a property when querying . [sent-18, score-0.154]
3 Previously only the ID was returned and the attributes had to be returned in separate calls. [sent-19, score-0.22]
4 Update 30 : Amazon SimpleDB - A distributed, highly-scalable, light-weight, query-able, attribute store by Sebastian Stadil . [sent-25, score-0.179]
5 Lots of fond memories of the new kid on the block showing us how objects and code were one, the endless OO vs. [sent-29, score-0.125]
6 Update 25: Nati Shalom thinks SDB isn't even a database . [sent-36, score-0.134]
7 It provides a memcached layer in front of a database storing data in S3. [sent-38, score-0.108]
8 Update 22: On an Erlang email list Jim Larson says the proper model is to store bulk data in S3 and indexable metadata in SimpleDB. [sent-41, score-0.214]
9 Update 20: Grow some stones, smoothspan says Eventual Consistency Is Not That Scary . [sent-45, score-0.12]
10 Update 16: Snarfed sees it as a sort of tuplespace implementation. [sent-50, score-0.11]
11 Update 15: Uncom thinks Winer & Scoble Fail In Tandem . [sent-53, score-0.081]
12 Update 11: DBA4Life says Amazon has just flux capacited us back to 1980s style database management. [sent-60, score-0.102]
13 CouchDB supports JSON data types and SimpleDB thinks everything is a string. [sent-74, score-0.081]
14 Update 3: Marcelo Calbucci thinks SimpleDB is more of a directory service than a database because records can contain different attributes (no schema) and attributes can have multiple values. [sent-81, score-0.33]
15 He thinks most queries will be easy to convert as they are predominantly hash like lookups anyway. [sent-83, score-0.206]
16 The cherry missing from Amazon's AWS hot fudge sundae was a database service. [sent-92, score-0.15]
17 They had a CPU scoop with EC2, they had storage scoop with S3, they had a work distribution scoop with their queue, but the database cherry was missing. [sent-93, score-0.609]
18 It seems to be a simple properties like store implemented on Erlang (as is CouchDB). [sent-98, score-0.104]
19 Most high speed websites use a property store for unstructured data and that's been hard for smaller groups to implement at scale. [sent-107, score-0.16]
20 But if you're losing your mind trying to figure out how to store your data at scale, maybe you can now turn your attention to more productive problems. [sent-108, score-0.104]
wordName wordTfidf (topN-words)
[('simpledb', 0.61), ('sdb', 0.194), ('amazon', 0.187), ('couchdb', 0.161), ('scoop', 0.153), ('erlang', 0.14), ('smoothspan', 0.12), ('store', 0.104), ('attributes', 0.098), ('cherry', 0.097), ('rdbms', 0.081), ('thinks', 0.081), ('attribute', 0.075), ('scoble', 0.075), ('hash', 0.074), ('block', 0.071), ('beta', 0.068), ('apparently', 0.065), ('asks', 0.061), ('returned', 0.061), ('update', 0.057), ('sort', 0.056), ('metadata', 0.056), ('property', 0.056), ('front', 0.055), ('fond', 0.054), ('uswhy', 0.054), ('indexable', 0.054), ('aa', 0.054), ('doubts', 0.054), ('monk', 0.054), ('oodbms', 0.054), ('smug', 0.054), ('styled', 0.054), ('subbu', 0.054), ('tuplespace', 0.054), ('warfield', 0.054), ('winer', 0.054), ('previously', 0.053), ('database', 0.053), ('theaws', 0.051), ('predominantly', 0.051), ('streamline', 0.051), ('adata', 0.051), ('perl', 0.05), ('structured', 0.049), ('stones', 0.049), ('ning', 0.049), ('jacob', 0.049), ('flux', 0.049)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000004 498 high scalability-2009-01-20-Product: Amazon's SimpleDB
Introduction: Update 35 : How and Why Glue is Using Amazon SimpleDB instead of a Relational Database . Discusses a key design decision that required duplicating data in order to mimic RDBMS joins: Given the trade off between potential inconsistencies and scalability, social services have to choose the latter. Update 34 : Apparently Amazon pulled this article. I'm not sure what that means. Maybe time went backwards or something? Amazon dramatically drops SimpleDB pricing to $0.25 per GB per month from $1.50 per GB . This puts SimpleDB on par with Google App Engine . They also announced a few new features: a SQL-like SELECT API as well as a Batch Put operation to streamline uploading of multiple items or attributes . One of the complaints against SimpleDB is that programmers end up writing too much code to do simple things. These features and a much cheaper price should help considerably. And you can store lots of data now. GAE is still capped. Update 33 : Amazon announces
2 0.42996448 184 high scalability-2007-12-13-Amazon SimpleDB - Scalable Cloud Database
Introduction: Amazon has announced the limited beta of Amazon SimpleDB - a simple web services interface to create and store multiple data sets, query your data easily, and return the results. Together with the Simple Storage Service (S3), Elastic Compute Cloud (EC2) and other web services Amazon offers a complete utility computing platform. SimpleDB was the missing piece of AWS - the scalable structured database. Check out my blog entry: http://innowave.blogspot.com/2007/12/amazon-simpledb-scalable-cloud-database.html I was waiting for this one :-) Geekr
3 0.41790876 306 high scalability-2008-04-21-The Search for the Source of Data - How SimpleDB Differs from a RDBMS
Introduction: Update 2: Yurii responds with the Top 10 Reasons to Avoid Document Databases FUD . Update: Top 10 Reasons to Avoid the SimpleDB Hype by Ryan Park provides a well written counter take. Am I really that fawning? If so, doesn't that make me a dear? All your life you've used a relational database. At the tender age of five you banged out your first SQL query to track your allowance. Your RDBMS allegiance was just assumed, like your politics or religion would have been assumed 100 years ago. They now say--you know them--that relations won't scale and we have to do things differently. New databases like SimpleDB and BigTable are what's different. As a long time RDBMS user what can you expect of SimpleDB? That's what Alex Tolley of MyMeemz.com set out to discover. Like many brave explorers before him, Alex gave a report of his adventures to the Royal Society of the AWS Meetup . Alex told a wild almost unbelievable tale of cultures and practices so different from our own you alm
4 0.29071468 925 high scalability-2010-10-22-Paper: Netflix’s Transition to High-Availability Storage Systems
Introduction: In an audacious move for such an established property, Netflix is moving their website out of the comfort of their own datacenter and into the wilds of the Amazon cloud. This paper by Netflix's Siddharth “Sid” Anand, Netflix’s Transition to High-Availability Storage Systems , gives a detailed look at this transition and does a deep dive on SimpleDB best practices, focussing especially on techniques useful to those who are making the move from a RDBMS. Sid is going to give a talk at QCon based on this paper and he would appreciate your feedback. So if you have any comments or thoughts please comment here or email Sid at r39132@hotmail.com or Twitter at @r39132 Here's the introduction from the paper: Circa late 2008, Netflix had a single data center. This single data center raised a few concerns. As a single-point-of-failure (a.k.a. SPOF), it represented a liability – data center outages meant interruptions to service and negative customer impact. Additionally, with growth in both
5 0.28280813 187 high scalability-2007-12-14-The Current Pros and Cons List for SimpleDB
Introduction: Not surprisingly opinions on SimpleDB vary from it sucks, don't take my database, to it will change the world, who needs a database anyway? From a quick survey of the blogosphere , here's where SimpleDB stands at the moment: SimpleDB Cons No SLA. We don't know how reliable it will be, how fast it will be, or how consistent the performance will be. Consistency constraints are relaxed. Reading data immediately after a write may not reflect the latest updates. To programmers used to transactions, this may be surprising, but many people think this is one of the tradeoffs that needs to be made to scale. Database is a core competency. If you don't control your database you can't out compete your competition. When your database is out of your control you can't guarantee it will work properly. You can't create the proper indexes and other optimizations. No join or IN operator. You'll need to do multiple client side calls to simulate joins, which will be slow. No
7 0.22742786 317 high scalability-2008-05-10-Hitting 300 SimbleDB Requests Per Second on a Small EC2 Instance
8 0.21042244 831 high scalability-2010-05-26-End-To-End Performance Study of Cloud Services
9 0.19244137 767 high scalability-2010-01-27-Hot Scalability Links for January 28 2010
10 0.175111 736 high scalability-2009-11-04-Damn, Which Database do I Use Now?
11 0.16961944 1090 high scalability-2011-08-01-Peecho Architecture - scalability on a shoestring
12 0.16412888 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
13 0.16349101 674 high scalability-2009-08-07-The Canonical Cloud Architecture
14 0.15224119 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
15 0.14179114 526 high scalability-2009-03-05-Strategy: In Cloud Computing Systematically Drive Load to the CPU
16 0.13480316 279 high scalability-2008-03-17-Microsoft's New Database Cloud Ready to Rumble with Amazon
17 0.1329564 589 high scalability-2009-05-05-Drop ACID and Think About Data
18 0.12966466 517 high scalability-2009-02-21-Google AppEngine - A Second Look
19 0.12756529 96 high scalability-2007-09-18-Amazon Architecture
20 0.12619559 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
topicId topicWeight
[(0, 0.218), (1, 0.101), (2, 0.001), (3, 0.062), (4, -0.016), (5, 0.041), (6, -0.007), (7, -0.14), (8, 0.1), (9, -0.125), (10, 0.001), (11, -0.05), (12, -0.039), (13, -0.055), (14, 0.019), (15, -0.049), (16, -0.095), (17, -0.027), (18, 0.046), (19, -0.06), (20, 0.005), (21, -0.051), (22, 0.065), (23, 0.001), (24, 0.017), (25, -0.107), (26, 0.098), (27, -0.02), (28, 0.184), (29, 0.009), (30, -0.005), (31, -0.064), (32, -0.055), (33, -0.059), (34, 0.071), (35, -0.022), (36, 0.041), (37, 0.129), (38, -0.008), (39, -0.03), (40, -0.046), (41, -0.103), (42, 0.06), (43, -0.032), (44, 0.027), (45, 0.034), (46, -0.018), (47, -0.068), (48, 0.058), (49, -0.008)]
simIndex simValue blogId blogTitle
same-blog 1 0.96305501 498 high scalability-2009-01-20-Product: Amazon's SimpleDB
Introduction: Update 35 : How and Why Glue is Using Amazon SimpleDB instead of a Relational Database . Discusses a key design decision that required duplicating data in order to mimic RDBMS joins: Given the trade off between potential inconsistencies and scalability, social services have to choose the latter. Update 34 : Apparently Amazon pulled this article. I'm not sure what that means. Maybe time went backwards or something? Amazon dramatically drops SimpleDB pricing to $0.25 per GB per month from $1.50 per GB . This puts SimpleDB on par with Google App Engine . They also announced a few new features: a SQL-like SELECT API as well as a Batch Put operation to streamline uploading of multiple items or attributes . One of the complaints against SimpleDB is that programmers end up writing too much code to do simple things. These features and a much cheaper price should help considerably. And you can store lots of data now. GAE is still capped. Update 33 : Amazon announces
2 0.7924915 184 high scalability-2007-12-13-Amazon SimpleDB - Scalable Cloud Database
Introduction: Amazon has announced the limited beta of Amazon SimpleDB - a simple web services interface to create and store multiple data sets, query your data easily, and return the results. Together with the Simple Storage Service (S3), Elastic Compute Cloud (EC2) and other web services Amazon offers a complete utility computing platform. SimpleDB was the missing piece of AWS - the scalable structured database. Check out my blog entry: http://innowave.blogspot.com/2007/12/amazon-simpledb-scalable-cloud-database.html I was waiting for this one :-) Geekr
3 0.7737729 306 high scalability-2008-04-21-The Search for the Source of Data - How SimpleDB Differs from a RDBMS
Introduction: Update 2: Yurii responds with the Top 10 Reasons to Avoid Document Databases FUD . Update: Top 10 Reasons to Avoid the SimpleDB Hype by Ryan Park provides a well written counter take. Am I really that fawning? If so, doesn't that make me a dear? All your life you've used a relational database. At the tender age of five you banged out your first SQL query to track your allowance. Your RDBMS allegiance was just assumed, like your politics or religion would have been assumed 100 years ago. They now say--you know them--that relations won't scale and we have to do things differently. New databases like SimpleDB and BigTable are what's different. As a long time RDBMS user what can you expect of SimpleDB? That's what Alex Tolley of MyMeemz.com set out to discover. Like many brave explorers before him, Alex gave a report of his adventures to the Royal Society of the AWS Meetup . Alex told a wild almost unbelievable tale of cultures and practices so different from our own you alm
4 0.7605412 187 high scalability-2007-12-14-The Current Pros and Cons List for SimpleDB
Introduction: Not surprisingly opinions on SimpleDB vary from it sucks, don't take my database, to it will change the world, who needs a database anyway? From a quick survey of the blogosphere , here's where SimpleDB stands at the moment: SimpleDB Cons No SLA. We don't know how reliable it will be, how fast it will be, or how consistent the performance will be. Consistency constraints are relaxed. Reading data immediately after a write may not reflect the latest updates. To programmers used to transactions, this may be surprising, but many people think this is one of the tradeoffs that needs to be made to scale. Database is a core competency. If you don't control your database you can't out compete your competition. When your database is out of your control you can't guarantee it will work properly. You can't create the proper indexes and other optimizations. No join or IN operator. You'll need to do multiple client side calls to simulate joins, which will be slow. No
5 0.72728741 38 high scalability-2007-07-30-Build an Infinitely Scalable Infrastructure for $100 Using Amazon Services
Introduction: Can you really create an infinitely scalable infrastructure for less than $100 using Amazon's storage, grid, and queuing services platform? It appears so, at least for the right application. Amazon beams a spot light on the future battle of the roll-your-own versus the connect-the-dots approach to building next generation websites using core external services. Their argument is strong. Using Amazon's platform you can quickly build an infrastructure that would otherwise take an eternity to make, a pile of money to create, and an unbounded mass of people to implement and maintain. Yet Amazon doesn't provide SLAs, so you can you really trust them with your crown jewels? Facebook recently leap frogged Amazon's vision with an even more comprehensive set of services. The battle for the future is on. Site: http://aws.amazon.com/ Information Sources Slides: Building Highly Scalable Web Applications Podcast: Technometria: Amazon Web Services Amazon Services Home . Platform
6 0.69795781 736 high scalability-2009-11-04-Damn, Which Database do I Use Now?
7 0.68378741 925 high scalability-2010-10-22-Paper: Netflix’s Transition to High-Availability Storage Systems
8 0.65679723 317 high scalability-2008-05-10-Hitting 300 SimbleDB Requests Per Second on a Small EC2 Instance
10 0.63434315 139 high scalability-2007-10-30-Paper: Dynamo: Amazon’s Highly Available Key-value Store
11 0.63329369 1028 high scalability-2011-04-22-Stuff The Internet Says On Scalability For April 22, 2011
12 0.630548 767 high scalability-2010-01-27-Hot Scalability Links for January 28 2010
13 0.62858748 1098 high scalability-2011-08-15-Should any cloud be considered one availability zone? The Amazon experience says yes.
14 0.61931437 477 high scalability-2008-12-29-100% on Amazon Web Services: Soocial.com - a lesson of porting your service to Amazon
15 0.61785835 279 high scalability-2008-03-17-Microsoft's New Database Cloud Ready to Rumble with Amazon
16 0.61682355 40 high scalability-2007-07-30-Product: Amazon Elastic Compute Cloud
17 0.61491257 1090 high scalability-2011-08-01-Peecho Architecture - scalability on a shoestring
18 0.61477685 610 high scalability-2009-05-29-Is Eucalyptus ready to be your private cloud?
19 0.61129397 200 high scalability-2008-01-02-WEB hosting Select
20 0.60830605 798 high scalability-2010-03-22-7 Secrets to Successfully Scaling with Scalr (on Amazon) by Sebastian Stadil
topicId topicWeight
[(1, 0.108), (2, 0.182), (10, 0.109), (28, 0.011), (40, 0.017), (61, 0.095), (76, 0.013), (77, 0.019), (79, 0.102), (85, 0.054), (89, 0.149), (94, 0.048)]
simIndex simValue blogId blogTitle
1 0.97643661 1503 high scalability-2013-08-19-What can the Amazing Race to the South Pole Teach us About Startups?
Introduction: At the heart of every software adventure exists a journey in service of a quest. Melodramatic much? Sorry, but while wandering dazzled through Race to the End of the Earth , a fantastic exhibit at the Royal BC Museum on the 1911-1912 race to the South Pole between Norwegian explorer Roald Amundsen and British naval officer Robert Scott , I couldn’t help but think of the two radically different approaches each team took to the race and it shocked me to see that some of the same principles that lead to success or failure in software development also seem to lead to success or failure in exploration. I wish I could reproduce the experience of walking through the exhibit . Plaque after plaque I remember wondering out loud at Scott’s choices and then nod in agreement with Amundsen’s approach. The core conflict was straight out of any ancient Agile (Amundsen) vs Waterfall (Scott) thread you can find on Usenet. And Waterfall lost. As background here are some sources you may want
same-blog 2 0.90160507 498 high scalability-2009-01-20-Product: Amazon's SimpleDB
Introduction: Update 35 : How and Why Glue is Using Amazon SimpleDB instead of a Relational Database . Discusses a key design decision that required duplicating data in order to mimic RDBMS joins: Given the trade off between potential inconsistencies and scalability, social services have to choose the latter. Update 34 : Apparently Amazon pulled this article. I'm not sure what that means. Maybe time went backwards or something? Amazon dramatically drops SimpleDB pricing to $0.25 per GB per month from $1.50 per GB . This puts SimpleDB on par with Google App Engine . They also announced a few new features: a SQL-like SELECT API as well as a Batch Put operation to streamline uploading of multiple items or attributes . One of the complaints against SimpleDB is that programmers end up writing too much code to do simple things. These features and a much cheaper price should help considerably. And you can store lots of data now. GAE is still capped. Update 33 : Amazon announces
3 0.89798331 32 high scalability-2007-07-26-Product: eAccelerator a PHP Accelerator
Introduction: eAccelerator is a free open-source PHP accelerator, optimizer, and dynamic content cache. It increases the performance of PHP scripts by caching them in their compiled state, so that the overhead of compiling is almost completely eliminated. It also optimizes scripts to speed up their execution. eAccelerator typically reduces server load and increases the speed of your PHP code by 1-10 times.
4 0.89585578 1187 high scalability-2012-02-03-Stuff The Internet Says On Scalability For February 3, 2012
Introduction: I'm only here for the HighScalability: 762 billion : objects stored on S3; $1B/Quarter : Google spend on servers; 100 Petabytes : Storage for Facebook's photos and videos. Quotable Quotes: @knorth2 : #IPO filing says #Facebook is "dependent on our ability to maintain and scale our technical infrastructure" @debuggist : Scalability trumps politics. @cagedether : Hype of #Hadoop is driving pressure on people to keep everything @nanreh : My MongoDB t shirt has never helped me get laid. This is typical with #nosql databases. @lusis : I kenna do it, Capt'n. IO is pegged, disk is saturated…I lost 3 good young men when the cache blew up! Kenton Varda : Jeff Dean puts his pants on one leg at a time, but if he had more than two legs, you'd see that his approach is actually O(log n) One upon a time manufacturing located near rivers for power. Likewise software will be located next to storage, CPU, and analytics resources in a small cartel of clouds. That's the c
5 0.89185274 1210 high scalability-2012-03-16-Stuff The Internet Says On Scalability For March 16, 2012
Introduction: HighScalability is What We Do: 454,400 : Number of Amazon servers; 45PB : Facebook Data Warehouse, grows exponentially; 5 Atoms : Ultimate limit of thermodynamics; YouTube : 4 billion views/day, 60 hours of video uploaded every minute, revenue doubled in 2010 Quotable quotes: @adrianco : Walmart labs run large single region Cassandra clusters with Intel SSDs and have been in production for two years. Working well for them. @mybellemac : Scalability is a mother. #pinterest @fakesigi : Thanks for the correction. I saw cloud computing, scalability and my brain turned off. @BVA100 : I disagree with "If it ain't broke, don't fix it". We ought to be forward thinkers, concerned with leading indicators and scalability. Dilbert on the meaning of it all . Cassandra and Solid State Drives . DataStax's Rick Branson with a sweet explanation of how Cassandra was built for a world of spinning disks, which means it only writes sequentially, w
6 0.88931096 398 high scalability-2008-09-30-Scalability Worst Practices
7 0.87993795 1197 high scalability-2012-02-21-Pixable Architecture - Crawling, Analyzing, and Ranking 20 Million Photos a Day
8 0.8772999 154 high scalability-2007-11-15-Lessons from Yahoo, eBay, Orbitz, LinkedIn architecture
9 0.86641425 160 high scalability-2007-11-19-Tailrank Architecture - Learn How to Track Memes Across the Entire Blogosphere
10 0.86268342 716 high scalability-2009-10-06-Building a Unique Data Warehouse
11 0.86208016 142 high scalability-2007-11-05-Strategy: Diagonal Scaling - Don't Forget to Scale Out AND Up
12 0.85966951 257 high scalability-2008-02-22-Kevin's Great Adventures in SSDland
14 0.85785842 619 high scalability-2009-06-05-HotPads Shows the True Cost of Hosting on Amazon
15 0.85637766 1380 high scalability-2013-01-02-Why Pinterest Uses the Cloud Instead of Going Solo - To Be Or Not To Be
16 0.85624319 72 high scalability-2007-08-22-Wikimedia architecture
17 0.85596967 1626 high scalability-2014-04-04-Stuff The Internet Says On Scalability For April 4th, 2014
18 0.85434502 1331 high scalability-2012-10-02-An Epic TripAdvisor Update: Why Not Run on the Cloud? The Grand Experiment.
19 0.85432082 1291 high scalability-2012-07-25-Vertical Scaling Ascendant - How are SSDs Changing Architectures?
20 0.85294074 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture