high_scalability high_scalability-2010 high_scalability-2010-776 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: My Life With Hbase by Lars George. The hardscabble tale of Hbase's growth from infancy to maturity. A very good introduction and overview of Hbase. NoSQL Alternatives -- Common Principles and Patterns for Building Scalable Applications . Explore the common principles behind the major NOSQL alternatives and how they compared with traditional database approach in terms of consistency, transaction and query semantics. We will also explore how we can make the transition between the two models smoothers through the support of standard interfaces such as JPA. Moore’s Law: The Future of Cloud Computing from the Bottom Up . Will Intel's 48 mega core chip change the world or be just another Spruce Goose? Rent or Own: Amazon EC2 vs. Colocation Comparison for Hadoop Clusters . It's much cheaper to own when you have a large relatively fixed size cluster and can find really cheap labor to maintain it all. A cloud in a plug - brilliant . A tiny, low-power, low-cost home server and N
sentIndex sentText sentNum sentScore
1 The hardscabble tale of Hbase's growth from infancy to maturity. [sent-2, score-0.236]
2 Explore the common principles behind the major NOSQL alternatives and how they compared with traditional database approach in terms of consistency, transaction and query semantics. [sent-5, score-0.495]
3 Will Intel's 48 mega core chip change the world or be just another Spruce Goose? [sent-8, score-0.112]
4 It's much cheaper to own when you have a large relatively fixed size cluster and can find really cheap labor to maintain it all. [sent-11, score-0.215]
5 A tiny, low-power, low-cost home server and NAS device powered by Tonido software that allows you to access your apps, files, music and media from anywhere. [sent-13, score-0.162]
6 Quick recap of databases that suck - or at least, suck for my purposes - and some that I'm still investigating. [sent-15, score-0.545]
7 An excellent article by Bartosz Milewski showing how he did a concurrency rewrite for a real-life software product called Code Co-op. [sent-21, score-0.188]
8 Aims at using Cassandra to make a easier to deploy and maintain backend for Lucene. [sent-25, score-0.299]
9 A product often defined more by it's limits, GAE has just got a lot easier to use. [sent-30, score-0.189]
10 GAE now has cursors and the 1000 item return limit has gone. [sent-31, score-0.126]
11 While a much easier programming model it will be curious to see how this impacts scalability and resource usage. [sent-32, score-0.366]
12 One of the canonical ideas of GAE has been to do work on writes to make reads fast, now programmers will be tempted to do more work on reads which will probably be slower and cost a lot more. [sent-33, score-0.413]
13 Another addition is the automatic retries of datastore operations. [sent-34, score-0.252]
14 Users should never have to retry, as only the lower layers know enough if a retry is necessary, so this makes a life a lot easier and will remove a ton of dead code from programs. [sent-35, score-0.568]
15 An on-demand service allows GoGrid customers to take advantage of Gear6’s robust, commercial-grade Memcached offering to speed up, scale out and ensure uptime for their web services and applications. [sent-37, score-0.083]
wordName wordTfidf (topN-words)
[('gae', 0.222), ('retry', 0.192), ('easier', 0.189), ('suck', 0.171), ('alternatives', 0.168), ('datastore', 0.154), ('infancy', 0.141), ('spruce', 0.141), ('principles', 0.133), ('goose', 0.132), ('hbaseby', 0.132), ('milewski', 0.132), ('tempted', 0.132), ('sdk', 0.126), ('cursors', 0.126), ('bartosz', 0.121), ('recap', 0.118), ('gogrid', 0.114), ('ricky', 0.114), ('overview', 0.114), ('mega', 0.112), ('maintain', 0.11), ('lars', 0.109), ('common', 0.109), ('concurrency', 0.106), ('royans', 0.105), ('labor', 0.105), ('nas', 0.103), ('versioning', 0.098), ('retries', 0.098), ('life', 0.098), ('plug', 0.096), ('impacts', 0.095), ('tale', 0.095), ('canonical', 0.095), ('colocation', 0.093), ('reads', 0.093), ('aims', 0.092), ('rent', 0.091), ('ton', 0.089), ('lucene', 0.089), ('purposes', 0.085), ('bottom', 0.085), ('major', 0.085), ('snapshot', 0.085), ('uptime', 0.083), ('curious', 0.082), ('excellent', 0.082), ('music', 0.081), ('powered', 0.081)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000001 776 high scalability-2010-02-12-Hot Scalability Links for February 12, 2010
Introduction: My Life With Hbase by Lars George. The hardscabble tale of Hbase's growth from infancy to maturity. A very good introduction and overview of Hbase. NoSQL Alternatives -- Common Principles and Patterns for Building Scalable Applications . Explore the common principles behind the major NOSQL alternatives and how they compared with traditional database approach in terms of consistency, transaction and query semantics. We will also explore how we can make the transition between the two models smoothers through the support of standard interfaces such as JPA. Moore’s Law: The Future of Cloud Computing from the Bottom Up . Will Intel's 48 mega core chip change the world or be just another Spruce Goose? Rent or Own: Amazon EC2 vs. Colocation Comparison for Hadoop Clusters . It's much cheaper to own when you have a large relatively fixed size cluster and can find really cheap labor to maintain it all. A cloud in a plug - brilliant . A tiny, low-power, low-cost home server and N
2 0.20860791 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
Introduction: When I was a child, I spake as a child, I understood as a child, I thought as a child: but when I became a man, I put away childish things . -- Corinthians With this new pricing, developments will be driven by the costs . I like to optimize my apps to make them better or faster, but to optimize them just to make them cheaper is a waste of time. -- Sylvain on Google Groups The dream is dead. Google App Engine's bold pay for what you use dream dies as it leaves childish things behind and becomes a real product . Pricing will change . Architectures will change. Customers will change. Hearts and minds will change. But Google App Engine will survive. Google is shutting down many of its projects . GAE is not among them. Do we have GAE's pricing change to thank for it surving the more wood behind more deadly arrows push? Without a radical and quick shift towards profitably GAE would no doubt be a historical footnote in the long scroll of good ideas. The urgency involve
3 0.19819871 517 high scalability-2009-02-21-Google AppEngine - A Second Look
Introduction: Update 6: : Back to the Future for Data Storage . We are in the middle of a renaissance in data storage with the application of many new ideas and techniques; there's huge potential for breaking out of thinking about data storage in just one way. Update 5 : Building Scalable Web Applications with Google App Engine by Brett Slatkin. Update 4 : Why Google App Engine is broken and what Google must do to fix it by Aral Balkan. We don't care that it can scale. We care that it does scale. And that it scales when you need it the most. Issues: 1MB limit on data structures; 1MB limit on data structures; the short-term high CPU quota; quotas in general; Admin? What's that? Update 3 : BigTable Blues . Catherine Devlin couldn't port an application to GAE because it can't do basic filtering and can't search 5,000 records without timing out: "Querying from 5000 records - too much for the mighty BigTable, apparently." Followup: not the future database . "90% of the work of this proje
4 0.12244266 327 high scalability-2008-05-27-How I Learned to Stop Worrying and Love Using a Lot of Disk Space to Scale
Introduction: Update 3 : ReadWriteWeb says Google App Engine Announces New Pricing Plans, APIs, Open Access . Pricing is specified but I'm not sure what to make of it yet. An image manipulation library is added (thus the need to pay for more CPU :-) and memcached support has been added. Memcached will help resolve the can't write for every read problem that pops up when keeping counters. Update 2 : onGWT.com threw a GAE load party and a lot of people came. The results at Load test : Google App Engine = 1, Community = 0 . GAE handled a peak of 35 requests/second and a sustained 10 requests/second. Some think performance was good, others not so good. My GMT watch broke and I was late to arrive. Maybe next time. Also added a few new design rules from the post. Update : Added a few new rules gleaned from the GAE Meetup : Design By Explicit Cost Model and Puts are Precious. How do you structure your database using a distributed hash table like BigTable ? The answer isn't what you might expect. If
5 0.12087884 789 high scalability-2010-03-05-Strategy: Planning for a Power Outage Google Style
Introduction: We can all learn from problems. The Google App Engine team has created a teachable moment through a remarkably honest and forthcoming post-mortem for February 24th, 2010 outage post, chronicling in elaborate detail a power outage that took down Google App Engine for a few hours. The world is ending! The cloud is unreliable! Jump ship! Not. This is not evidence that the cloud is a beautiful, powerful and unsinkable ship that goes down on its maiden voyage. Stuff happens, no matter how well you prepare. If you think private datacenters don't go down, well, then I have some rearangeable deck chairs to sell you. The goal is to keep improving and minimizing those failure windows. From that perspective there is a lot to learn from the problems the Google App Engine team encountered and how they plan to fix them. Please read the article for all the juicy details, but here's what struck me as key: Power fails. Plan for it . This seems to happen with unexpected frequency for su
6 0.11723857 1055 high scalability-2011-06-08-Stuff to Watch from Google IO 2011
7 0.11625798 927 high scalability-2010-10-26-Marrying memcached and NoSQL
8 0.11550672 1432 high scalability-2013-04-01-Khan Academy Checkbook Scaling to 6 Million Users a Month on GAE
9 0.1153274 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
10 0.11532336 687 high scalability-2009-08-24-How Google Serves Data from Multiple Datacenters
11 0.11480942 1109 high scalability-2011-09-02-Stuff The Internet Says On Scalability For September 2, 2011
12 0.11450475 749 high scalability-2009-12-15-The Common Principles Behind the NOSQL Alternatives
13 0.11397436 1023 high scalability-2011-04-14-Strategy: Cache Application Start State to Reduce Spin-up Times
14 0.11383177 943 high scalability-2010-11-16-Facebook's New Real-time Messaging System: HBase to Store 135+ Billion Messages a Month
16 0.11259743 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
17 0.10928367 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
18 0.10628861 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
19 0.10582335 1064 high scalability-2011-06-20-35+ Use Cases for Choosing Your Next NoSQL Database
20 0.10469717 336 high scalability-2008-05-31-Biggest Under Reported Story: Google's BigTable Costs 10 Times Less than Amazon's SimpleDB
topicId topicWeight
[(0, 0.194), (1, 0.084), (2, 0.039), (3, 0.072), (4, -0.007), (5, 0.039), (6, -0.024), (7, -0.053), (8, 0.056), (9, -0.023), (10, 0.009), (11, -0.03), (12, -0.04), (13, -0.002), (14, -0.025), (15, -0.042), (16, -0.066), (17, -0.003), (18, 0.033), (19, -0.039), (20, -0.023), (21, -0.017), (22, -0.009), (23, -0.053), (24, 0.073), (25, -0.002), (26, 0.058), (27, -0.039), (28, 0.016), (29, -0.03), (30, 0.008), (31, 0.005), (32, 0.003), (33, -0.015), (34, -0.027), (35, 0.028), (36, -0.029), (37, 0.003), (38, 0.05), (39, -0.064), (40, -0.048), (41, 0.015), (42, -0.034), (43, 0.019), (44, 0.004), (45, 0.038), (46, -0.038), (47, 0.083), (48, 0.003), (49, -0.015)]
simIndex simValue blogId blogTitle
same-blog 1 0.95483249 776 high scalability-2010-02-12-Hot Scalability Links for February 12, 2010
Introduction: My Life With Hbase by Lars George. The hardscabble tale of Hbase's growth from infancy to maturity. A very good introduction and overview of Hbase. NoSQL Alternatives -- Common Principles and Patterns for Building Scalable Applications . Explore the common principles behind the major NOSQL alternatives and how they compared with traditional database approach in terms of consistency, transaction and query semantics. We will also explore how we can make the transition between the two models smoothers through the support of standard interfaces such as JPA. Moore’s Law: The Future of Cloud Computing from the Bottom Up . Will Intel's 48 mega core chip change the world or be just another Spruce Goose? Rent or Own: Amazon EC2 vs. Colocation Comparison for Hadoop Clusters . It's much cheaper to own when you have a large relatively fixed size cluster and can find really cheap labor to maintain it all. A cloud in a plug - brilliant . A tiny, low-power, low-cost home server and N
2 0.77279484 1084 high scalability-2011-07-22-Stuff The Internet Says On Scalability For July 22, 2011
Introduction: Submitted for your scaling pleasure: Google's PageRank involves 500 million variables and 2 billion terms . SeaMicro Packs 768 Cores Into its Atom Server . Twitter: 1 Billion Items Delivered A Day Is Nice, Google+. We Do 350 Billion. Potent quotables: @merv - Does elastic scalability matter? Ask Apple about 1 million e-transactions in a day. $30M worth of multi-gig downloads that must work. @lmacvittie - Cloud has shifted the focus of scalability from applications to architecture. @bartbohn - Love the phrase "anarchic scalability" by Roy Fielding @iAjayMe - Programming: I have come to the conclusion, if you want to do something right the first time (scalability,performance) write it in C++ @mreferre - Interesting discussion between @jamesurquhart and @lmacvittie about PaaS/App scalability (I think). Need google translator though... @krisajenkins - My deal with #nosql: if I'm giving up transactions, it has to buy me no SPOF. @c3iq - "Hundred
3 0.75854808 517 high scalability-2009-02-21-Google AppEngine - A Second Look
Introduction: Update 6: : Back to the Future for Data Storage . We are in the middle of a renaissance in data storage with the application of many new ideas and techniques; there's huge potential for breaking out of thinking about data storage in just one way. Update 5 : Building Scalable Web Applications with Google App Engine by Brett Slatkin. Update 4 : Why Google App Engine is broken and what Google must do to fix it by Aral Balkan. We don't care that it can scale. We care that it does scale. And that it scales when you need it the most. Issues: 1MB limit on data structures; 1MB limit on data structures; the short-term high CPU quota; quotas in general; Admin? What's that? Update 3 : BigTable Blues . Catherine Devlin couldn't port an application to GAE because it can't do basic filtering and can't search 5,000 records without timing out: "Querying from 5000 records - too much for the mighty BigTable, apparently." Followup: not the future database . "90% of the work of this proje
4 0.74711961 763 high scalability-2010-01-22-How BuddyPoke Scales on Facebook Using Google App Engine
Introduction: How do you scale a viral Facebook app that has skyrocketed to a mind boggling 65 million installs (the population of France)? That's the fortunate problem BuddyPoke co-founder Dave Westwood has and he talked about his solution at Wednesday's Facebook Meetup . Slides for the complete talk are here . For those not quite sure what BuddyPoke is, it's a social network application that lets users show their mood, hug, kiss, and poke their friends through on-line avatars. In many ways BuddyPoke is the quintessentially modern web application. It thrives off the energy of social network driven ecosystems. Game play mechanics, viral loops, and creative monetization strategies are all part of if its everyday conceptualization. It mashes together different technologies, not in a dark Frankensteining sort of way, but in a smart way that gets the most bang for the buck. Part of it runs on Facebook servers (free). Part of it runs on flash in a browser (free). Part of it runs on a storage clou
5 0.73351192 1040 high scalability-2011-05-13-Stuff The Internet Says On Scalability For May 13, 2011
Introduction: Submitted for your reading pleasure on this beautiful blue sky, birds chirping Friday morning: Unlocked Achievements: Twitter: 900,000 Apps, 600,000 Developers And 13 Billion API Requests Per Day ; Rackspace Now Has 70,000 Servers Quotable Quotes for the speed of light Alex: @LusciousPear According to everyone I talk to, in aggregate, every single #nosql company is irrelevant, doing great, making tons of money, and broke. XIX Give a man a GO compiler and he eats for a day. Give a man a C compiler and he feeds upon php/python/jscript/lua/etc for the rest of his life. @movingsideways This tweet features a robust architecture and high scalability. @serenestudios Human touch trumps code 'scalability'? People matter more than code - we agree. @SunGardFS At current growth rates, server farms will consume more energy than all air travel by 2020 @marcloney After the hype of NoSQL, are we just going to end up with a bunch of enterprise-class produ
6 0.73249984 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
7 0.72751588 527 high scalability-2009-03-06-Cloud Programming Directly Feeds Cost Allocation Back into Software Design
8 0.72660518 1055 high scalability-2011-06-08-Stuff to Watch from Google IO 2011
9 0.70286912 1163 high scalability-2011-12-23-Stuff The Internet Says On Scalability For December 23, 2011
10 0.70108378 1113 high scalability-2011-09-09-Stuff The Internet Says On Scalability For September 9, 2011
11 0.69669664 1109 high scalability-2011-09-02-Stuff The Internet Says On Scalability For September 2, 2011
12 0.69011062 1028 high scalability-2011-04-22-Stuff The Internet Says On Scalability For April 22, 2011
13 0.68083674 1472 high scalability-2013-06-07-Stuff The Internet Says On Scalability For June 7, 2013
14 0.67935985 1182 high scalability-2012-01-27-Stuff The Internet Says On Scalability For January 27, 2012
15 0.67885315 1151 high scalability-2011-12-05-Stuff The Internet Says On Scalability For December 5, 2011
16 0.67862493 883 high scalability-2010-08-20-Hot Scalability Links For Aug 20, 2010
17 0.6768167 1015 high scalability-2011-04-01-Stuff The Internet Says On Scalability For April 1, 2011
18 0.67536134 1023 high scalability-2011-04-14-Strategy: Cache Application Start State to Reduce Spin-up Times
19 0.67386848 1080 high scalability-2011-07-15-Stuff The Internet Says On Scalability For July 15, 2011
20 0.67127675 327 high scalability-2008-05-27-How I Learned to Stop Worrying and Love Using a Lot of Disk Space to Scale
topicId topicWeight
[(1, 0.118), (2, 0.189), (10, 0.073), (30, 0.034), (40, 0.028), (61, 0.107), (67, 0.132), (79, 0.13), (85, 0.029), (94, 0.081)]
simIndex simValue blogId blogTitle
same-blog 1 0.9318223 776 high scalability-2010-02-12-Hot Scalability Links for February 12, 2010
Introduction: My Life With Hbase by Lars George. The hardscabble tale of Hbase's growth from infancy to maturity. A very good introduction and overview of Hbase. NoSQL Alternatives -- Common Principles and Patterns for Building Scalable Applications . Explore the common principles behind the major NOSQL alternatives and how they compared with traditional database approach in terms of consistency, transaction and query semantics. We will also explore how we can make the transition between the two models smoothers through the support of standard interfaces such as JPA. Moore’s Law: The Future of Cloud Computing from the Bottom Up . Will Intel's 48 mega core chip change the world or be just another Spruce Goose? Rent or Own: Amazon EC2 vs. Colocation Comparison for Hadoop Clusters . It's much cheaper to own when you have a large relatively fixed size cluster and can find really cheap labor to maintain it all. A cloud in a plug - brilliant . A tiny, low-power, low-cost home server and N
2 0.92463654 1422 high scalability-2013-03-12-If Your System was a Symphony it Might Sound Like This...
Introduction: I am in no way a music expert, but when I listen to Symphony No. 4 by Charles Ives , I imagine it's what a complex software/hardware system might sound like if we could hear its inner workings. Ives uses a lot of riotously competing rhythms in this work. It can sound discordant, yet the effect is deeply layered and eventually harmonious, just like the systems we use, create, and become part of. I was pointed to this piece by someone who said there were two conductors. I'd never heard of such a thing! So I was intrigued. The first version of the performance sounds and looks great, but it unfortunately does not use two conductors. The second version uses two conductors, but is unfortunately just a snippet. It's strikingly odd to see two conductors, but I imagine different parts of our systems using different conductors too, running at different rhythms, sometimes slow, sometimes fast, sometimes there are outbursts, sometimes in vicious conflict. Yet conceptually it all stills seem
3 0.91675299 1545 high scalability-2013-11-08-Stuff The Internet Says On Scalability For November 8th, 2013
Introduction: Hey, it's HighScalability time: Robot elephan t from 1950, which consisted of 9000 parts and could walk 27 mp/h Galaxy contains billions of potentially habitable planets . According to economic theory this should put a downward pressure on rents. Quotable Quotes: Brandon Downey : F*ck these guys. @IEEEorg : Every second 21.6 people get their first mobile device. Mobile is growing 5 times faster than the human population. @littleidea : a distributed system to deploy a distributed systems to deploy a distributed system, bring your own turtles @BenedictEvans : Photos shared/day: Facebook - 350m Snapchat - 350m Whatsapp - 400m Instagram: 55m. @SciencePorn : Price of 1gb of storage over time: 1981 $300000, 1987 $50000, 1990 $10000, 1994 $1000, 1997 $100, 2000 $10, 2004 $1, 2012 $0.10 @kellabyte : If I hear “network partitions are rare on even hundred(s) of node clusters” again I’m going to lose my shit. This fall
4 0.89833999 1649 high scalability-2014-05-16-Stuff The Internet Says On Scalability For May 16th, 2014
Introduction: Hey, it's HighScalability time: Cross Section of an Undersea Cable. It's industrial art. The parts . The story . 400,000,000,000 : Wayback Machine pages indexed; 100 billion : Google searches per month; 10 million : Snapchat monthly user growth. Quotable Quotes: @duncanjw : The Great Rewrite - many apps will be rewritten not just replatformed over next 10 years says @cote #openstacksummit @RFFlores : The Openstack conundrum. If you don't adopt it, you will regret it in the future. If you do adopt it, you will regret it now elementai : I love Redis so much, it became like a superglue where "just enough" performance is needed to resolve a bottleneck problem, but you don't have resources to rewrite a whole thing in something fast. @antirez : "when software engineering is reduced to plumbing together generic systems, software engineers lose their sense of ownership" Tom Akehurst : Microservices vs. monolith is a false di
Introduction: This is a guest post by Ivan de Prado and Pere Ferrera , founders of Datasalt , the company behind Pangool and Splout SQL Big Data open-source projects. The amount of payments performed using credit cards is huge. It is clear that there is inherent value in the data that can be derived from analyzing all the transactions. Client fidelity, demographics, heat maps of activity, shop recommendations, and many other statistics are useful to both clients and shops for improving their relationship with the market. At Datasalt we have developed a system in collaboration with the BBVA bank that is able to analyze years of data and serve insights and statistics to different low-latency web and mobile applications. The main challenge we faced besides processing Big Data input is that the output was also Big Data, and even bigger than the input . And this output needed to be served quickly, under high load. The solution we developed has an infrastructure cost of just a few tho
6 0.89232332 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
7 0.89090884 301 high scalability-2008-04-08-Google AppEngine - A First Look
8 0.89024848 289 high scalability-2008-03-27-Amazon Announces Static IP Addresses and Multiple Datacenter Operation
9 0.89000648 1180 high scalability-2012-01-24-The State of NoSQL in 2012
10 0.8890509 517 high scalability-2009-02-21-Google AppEngine - A Second Look
11 0.88831943 898 high scalability-2010-09-09-6 Scalability Lessons
12 0.88770002 851 high scalability-2010-07-02-Hot Scalability Links for July 2, 2010
13 0.88728583 195 high scalability-2007-12-28-Amazon's EC2: Pay as You Grow Could Cut Your Costs in Half
14 0.8868351 1389 high scalability-2013-01-18-Stuff The Internet Says On Scalability For January 18, 2013
15 0.88682652 498 high scalability-2009-01-20-Product: Amazon's SimpleDB
16 0.88500345 1559 high scalability-2013-12-06-Stuff The Internet Says On Scalability For December 6th, 2013
17 0.88486737 716 high scalability-2009-10-06-Building a Unique Data Warehouse
19 0.88436288 1148 high scalability-2011-11-29-DataSift Architecture: Realtime Datamining at 120,000 Tweets Per Second
20 0.8841297 1302 high scalability-2012-08-10-Stuff The Internet Says On Scalability For August 10, 2012