high_scalability high_scalability-2011 high_scalability-2011-1055 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: With the Google IO Developer Conference completed there are dozens and dozens of information packed videos now available. While you won't get any of the nifty free swag the attendees rake in, it's great of Google to make these videos available so quickly after the conference. Let's say you don't want to watch all the videos on the pretense you have a life, here are just a dozen scalability and architecture related videos you might find interesting: App Engine Backends by Justin Haugh, Greg Darke. One of this biggest complaints about GAE are the request deadlines. Those are now gone when you rent a new Backend node. Scaling App Engine Applications by Justin Haugh, Guido van Rossum. Two parts: how App Engine scales internally and how you as a programmer make it scale using the tools. Good discussion of scaling and why it's hard; 10,000 queries per second is a large app that needs good architecting; a good discussion of GAE's predictive scaling formula of how it decides w
sentIndex sentText sentNum sentScore
1 With the Google IO Developer Conference completed there are dozens and dozens of information packed videos now available. [sent-1, score-0.161]
2 While you won't get any of the nifty free swag the attendees rake in, it's great of Google to make these videos available so quickly after the conference. [sent-2, score-0.317]
3 Let's say you don't want to watch all the videos on the pretense you have a life, here are just a dozen scalability and architecture related videos you might find interesting: App Engine Backends by Justin Haugh, Greg Darke. [sent-3, score-0.322]
4 Scaling App Engine Applications by Justin Haugh, Guido van Rossum. [sent-6, score-0.119]
5 The less you do the faster it will be and the less it wil cost. [sent-9, score-0.087]
6 App Engine is just a backend for Facebook games, Google want to remind you that they do the Enterprise too: performance reviews, help desk, course scheduling, expense reporting, payroll, etc. [sent-13, score-0.075]
7 Fireside Chat with the App Engine Team with Max Ross, Alon Levi, Sean Lynch, Greg Dalesandre, Guido van Rossum, Brett Slatkin, Peter Magnusson, Mickey Kataria, Peter McKenzie. [sent-14, score-0.119]
8 The team talks about the pricing changes, HR datastore, and lots of great questions that lead to more great things to work on. [sent-16, score-0.068]
9 A quirky fact about a Google App Engine is that it did not support search. [sent-18, score-0.073]
10 Excellent discussion of the different tradeoffs and why they were made. [sent-26, score-0.119]
11 Always a great feature, task queues were restricted by being pushed based, now pull based queues make it possible to process tasks in a VM by pulling from queues using a REST API. [sent-28, score-0.533]
12 Page Speed is a tool that helps reduce the latency for mobile apps. [sent-33, score-0.08]
13 Good discussion of the issues and how to diagnose and fix them: cache, defer JavaScript, cache redirects, use touch events, enable keep-alives. [sent-34, score-0.19]
14 GAE+GWT+objectify+ other tools is an awesomely productive tool chain. [sent-38, score-0.113]
15 These talks are generally of high quality and provide insight you won't get elsewhere. [sent-40, score-0.068]
wordName wordTfidf (topN-words)
[('engine', 0.266), ('justin', 0.248), ('app', 0.243), ('gae', 0.23), ('haugh', 0.192), ('objectify', 0.192), ('guido', 0.164), ('videos', 0.161), ('queues', 0.154), ('datastore', 0.143), ('brett', 0.142), ('gwt', 0.138), ('van', 0.119), ('discussion', 0.119), ('map', 0.113), ('productive', 0.113), ('peter', 0.097), ('google', 0.092), ('payroll', 0.087), ('magnusson', 0.087), ('alon', 0.087), ('rossum', 0.087), ('swag', 0.087), ('verne', 0.087), ('vivek', 0.087), ('wil', 0.087), ('greg', 0.087), ('fried', 0.082), ('lynch', 0.082), ('alfred', 0.082), ('hr', 0.082), ('reduce', 0.08), ('ross', 0.078), ('chandler', 0.078), ('slatkin', 0.075), ('desk', 0.075), ('remind', 0.075), ('predictive', 0.075), ('redirects', 0.073), ('applicationsby', 0.073), ('quirky', 0.073), ('task', 0.071), ('thegoogle', 0.071), ('defer', 0.071), ('nicholas', 0.071), ('formula', 0.071), ('nifty', 0.069), ('talks', 0.068), ('quota', 0.068), ('bryan', 0.068)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 1055 high scalability-2011-06-08-Stuff to Watch from Google IO 2011
Introduction: With the Google IO Developer Conference completed there are dozens and dozens of information packed videos now available. While you won't get any of the nifty free swag the attendees rake in, it's great of Google to make these videos available so quickly after the conference. Let's say you don't want to watch all the videos on the pretense you have a life, here are just a dozen scalability and architecture related videos you might find interesting: App Engine Backends by Justin Haugh, Greg Darke. One of this biggest complaints about GAE are the request deadlines. Those are now gone when you rent a new Backend node. Scaling App Engine Applications by Justin Haugh, Guido van Rossum. Two parts: how App Engine scales internally and how you as a programmer make it scale using the tools. Good discussion of scaling and why it's hard; 10,000 queries per second is a large app that needs good architecting; a good discussion of GAE's predictive scaling formula of how it decides w
2 0.33126587 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
Introduction: When I was a child, I spake as a child, I understood as a child, I thought as a child: but when I became a man, I put away childish things . -- Corinthians With this new pricing, developments will be driven by the costs . I like to optimize my apps to make them better or faster, but to optimize them just to make them cheaper is a waste of time. -- Sylvain on Google Groups The dream is dead. Google App Engine's bold pay for what you use dream dies as it leaves childish things behind and becomes a real product . Pricing will change . Architectures will change. Customers will change. Hearts and minds will change. But Google App Engine will survive. Google is shutting down many of its projects . GAE is not among them. Do we have GAE's pricing change to thank for it surving the more wood behind more deadly arrows push? Without a radical and quick shift towards profitably GAE would no doubt be a historical footnote in the long scroll of good ideas. The urgency involve
3 0.29317418 517 high scalability-2009-02-21-Google AppEngine - A Second Look
Introduction: Update 6: : Back to the Future for Data Storage . We are in the middle of a renaissance in data storage with the application of many new ideas and techniques; there's huge potential for breaking out of thinking about data storage in just one way. Update 5 : Building Scalable Web Applications with Google App Engine by Brett Slatkin. Update 4 : Why Google App Engine is broken and what Google must do to fix it by Aral Balkan. We don't care that it can scale. We care that it does scale. And that it scales when you need it the most. Issues: 1MB limit on data structures; 1MB limit on data structures; the short-term high CPU quota; quotas in general; Admin? What's that? Update 3 : BigTable Blues . Catherine Devlin couldn't port an application to GAE because it can't do basic filtering and can't search 5,000 records without timing out: "Querying from 5000 records - too much for the mighty BigTable, apparently." Followup: not the future database . "90% of the work of this proje
4 0.21125148 301 high scalability-2008-04-08-Google AppEngine - A First Look
Introduction: I haven't developed an AppEngine application yet, I'm just taking a look around their documentation and seeing what stands out for me. It's not the much speculated super cluster VM . AppEngine is solidly grounded in code and structure. It reminds me a little of the guy who ran a website out of S3 with a splash of Heroku thrown in as a chaser. The idea is clearly to take advantage of our massive multi-core future by creating a shared nothing infrastructure based firmly on a core set of infinitely scalable database, storage and CPU services. Don't forget Google also has a few other services to leverage: email, login, blogs, video, search, ads, metrics, and apps. A shared nothing request is a simple beast. By its very nature shared nothing architectures must be composed of services which are themselves already scalable and Google is signing up to supply that scalable infrastructure. Google has been busy creating a platform of out-of-the-box scalable services to build
5 0.1572371 1432 high scalability-2013-04-01-Khan Academy Checkbook Scaling to 6 Million Users a Month on GAE
Introduction: Khan Academy is a non profit company started by Salman Khan with the Big Hairy Audacious Goal of providing a free, world class education to anyone, anywhere, anytime. That’s a lot of knowledge. Having long been inspired and captivated by the Khan Academy, I was really curious to know how they plan to do it. Ben Kamens , lead developer at Khan Academy, gives the somewhat surprising answer in an interview: How to Scale your Startup to Millions of Users . The short answer : develop a strong team, focus on features, let Google App Engine do the heavy lifting. Some people seem to be turned off by all the GAE love in the interview. Part of it is that the interviewer is Fred Sauer, Developer Advocate for Google App Engine, so there’s a level of familiarity between the two. But the biggest part is simply that they really like GAE, for all the reasons your are supposed to like GAE. And that’s OK. In this day and age you are free to love whichever platform you choose. Bigge
6 0.156519 763 high scalability-2010-01-22-How BuddyPoke Scales on Facebook Using Google App Engine
7 0.15577987 789 high scalability-2010-03-05-Strategy: Planning for a Power Outage Google Style
8 0.14627559 641 high scalability-2009-06-29-Google App Engine plus Amazon AWS: Best of both worlds
10 0.1342773 1472 high scalability-2013-06-07-Stuff The Internet Says On Scalability For June 7, 2013
11 0.1333181 1135 high scalability-2011-10-31-15 Ways to Make Your Application Feel More Responsive under Google App Engine
12 0.13101159 1084 high scalability-2011-07-22-Stuff The Internet Says On Scalability For July 22, 2011
13 0.12852851 1023 high scalability-2011-04-14-Strategy: Cache Application Start State to Reduce Spin-up Times
14 0.12581575 1275 high scalability-2012-07-02-C is for Compute - Google Compute Engine (GCE)
16 0.12191568 687 high scalability-2009-08-24-How Google Serves Data from Multiple Datacenters
17 0.12028061 1122 high scalability-2011-09-23-Stuff The Internet Says On Scalability For September 23, 2011
18 0.11723857 776 high scalability-2010-02-12-Hot Scalability Links for February 12, 2010
19 0.1170344 327 high scalability-2008-05-27-How I Learned to Stop Worrying and Love Using a Lot of Disk Space to Scale
20 0.11137266 448 high scalability-2008-11-22-Google Architecture
topicId topicWeight
[(0, 0.196), (1, 0.08), (2, 0.011), (3, 0.033), (4, -0.002), (5, -0.004), (6, 0.004), (7, 0.061), (8, 0.09), (9, -0.035), (10, -0.003), (11, -0.088), (12, 0.022), (13, -0.015), (14, -0.033), (15, -0.037), (16, -0.126), (17, -0.061), (18, 0.14), (19, -0.056), (20, 0.085), (21, -0.073), (22, 0.061), (23, -0.103), (24, 0.017), (25, 0.036), (26, 0.032), (27, -0.027), (28, -0.03), (29, -0.017), (30, 0.007), (31, -0.075), (32, 0.029), (33, -0.026), (34, -0.013), (35, 0.015), (36, 0.002), (37, -0.028), (38, 0.036), (39, -0.052), (40, 0.007), (41, -0.01), (42, -0.045), (43, 0.058), (44, 0.062), (45, 0.012), (46, -0.066), (47, 0.131), (48, -0.031), (49, -0.023)]
simIndex simValue blogId blogTitle
same-blog 1 0.97043669 1055 high scalability-2011-06-08-Stuff to Watch from Google IO 2011
Introduction: With the Google IO Developer Conference completed there are dozens and dozens of information packed videos now available. While you won't get any of the nifty free swag the attendees rake in, it's great of Google to make these videos available so quickly after the conference. Let's say you don't want to watch all the videos on the pretense you have a life, here are just a dozen scalability and architecture related videos you might find interesting: App Engine Backends by Justin Haugh, Greg Darke. One of this biggest complaints about GAE are the request deadlines. Those are now gone when you rent a new Backend node. Scaling App Engine Applications by Justin Haugh, Guido van Rossum. Two parts: how App Engine scales internally and how you as a programmer make it scale using the tools. Good discussion of scaling and why it's hard; 10,000 queries per second is a large app that needs good architecting; a good discussion of GAE's predictive scaling formula of how it decides w
2 0.80118233 1112 high scalability-2011-09-07-What Google App Engine Price Changes Say About the Future of Web Architecture
Introduction: When I was a child, I spake as a child, I understood as a child, I thought as a child: but when I became a man, I put away childish things . -- Corinthians With this new pricing, developments will be driven by the costs . I like to optimize my apps to make them better or faster, but to optimize them just to make them cheaper is a waste of time. -- Sylvain on Google Groups The dream is dead. Google App Engine's bold pay for what you use dream dies as it leaves childish things behind and becomes a real product . Pricing will change . Architectures will change. Customers will change. Hearts and minds will change. But Google App Engine will survive. Google is shutting down many of its projects . GAE is not among them. Do we have GAE's pricing change to thank for it surving the more wood behind more deadly arrows push? Without a radical and quick shift towards profitably GAE would no doubt be a historical footnote in the long scroll of good ideas. The urgency involve
3 0.80079144 517 high scalability-2009-02-21-Google AppEngine - A Second Look
Introduction: Update 6: : Back to the Future for Data Storage . We are in the middle of a renaissance in data storage with the application of many new ideas and techniques; there's huge potential for breaking out of thinking about data storage in just one way. Update 5 : Building Scalable Web Applications with Google App Engine by Brett Slatkin. Update 4 : Why Google App Engine is broken and what Google must do to fix it by Aral Balkan. We don't care that it can scale. We care that it does scale. And that it scales when you need it the most. Issues: 1MB limit on data structures; 1MB limit on data structures; the short-term high CPU quota; quotas in general; Admin? What's that? Update 3 : BigTable Blues . Catherine Devlin couldn't port an application to GAE because it can't do basic filtering and can't search 5,000 records without timing out: "Querying from 5000 records - too much for the mighty BigTable, apparently." Followup: not the future database . "90% of the work of this proje
4 0.79027295 301 high scalability-2008-04-08-Google AppEngine - A First Look
Introduction: I haven't developed an AppEngine application yet, I'm just taking a look around their documentation and seeing what stands out for me. It's not the much speculated super cluster VM . AppEngine is solidly grounded in code and structure. It reminds me a little of the guy who ran a website out of S3 with a splash of Heroku thrown in as a chaser. The idea is clearly to take advantage of our massive multi-core future by creating a shared nothing infrastructure based firmly on a core set of infinitely scalable database, storage and CPU services. Don't forget Google also has a few other services to leverage: email, login, blogs, video, search, ads, metrics, and apps. A shared nothing request is a simple beast. By its very nature shared nothing architectures must be composed of services which are themselves already scalable and Google is signing up to supply that scalable infrastructure. Google has been busy creating a platform of out-of-the-box scalable services to build
5 0.78689039 763 high scalability-2010-01-22-How BuddyPoke Scales on Facebook Using Google App Engine
Introduction: How do you scale a viral Facebook app that has skyrocketed to a mind boggling 65 million installs (the population of France)? That's the fortunate problem BuddyPoke co-founder Dave Westwood has and he talked about his solution at Wednesday's Facebook Meetup . Slides for the complete talk are here . For those not quite sure what BuddyPoke is, it's a social network application that lets users show their mood, hug, kiss, and poke their friends through on-line avatars. In many ways BuddyPoke is the quintessentially modern web application. It thrives off the energy of social network driven ecosystems. Game play mechanics, viral loops, and creative monetization strategies are all part of if its everyday conceptualization. It mashes together different technologies, not in a dark Frankensteining sort of way, but in a smart way that gets the most bang for the buck. Part of it runs on Facebook servers (free). Part of it runs on flash in a browser (free). Part of it runs on a storage clou
6 0.69998848 1084 high scalability-2011-07-22-Stuff The Internet Says On Scalability For July 22, 2011
7 0.69472355 1432 high scalability-2013-04-01-Khan Academy Checkbook Scaling to 6 Million Users a Month on GAE
8 0.6880039 789 high scalability-2010-03-05-Strategy: Planning for a Power Outage Google Style
9 0.68426496 641 high scalability-2009-06-29-Google App Engine plus Amazon AWS: Best of both worlds
10 0.67149192 1472 high scalability-2013-06-07-Stuff The Internet Says On Scalability For June 7, 2013
11 0.66643012 1117 high scalability-2011-09-16-Stuff The Internet Says On Scalability For September 16, 2011
12 0.66042775 1135 high scalability-2011-10-31-15 Ways to Make Your Application Feel More Responsive under Google App Engine
13 0.64845312 527 high scalability-2009-03-06-Cloud Programming Directly Feeds Cost Allocation Back into Software Design
14 0.64498544 1412 high scalability-2013-02-25-SongPop Scales to 1 Million Active Users on GAE, Showing PaaS is not Passé
15 0.64280456 1023 high scalability-2011-04-14-Strategy: Cache Application Start State to Reduce Spin-up Times
16 0.63285655 949 high scalability-2010-11-29-Stuff the Internet Says on Scalability For November 29th, 2010
17 0.63131893 1275 high scalability-2012-07-02-C is for Compute - Google Compute Engine (GCE)
18 0.62875712 1143 high scalability-2011-11-16-Google+ Infrastructure Update - the JavaScript Story
20 0.60599989 299 high scalability-2008-04-07-Rumors of Signs and Portents Concerning Freeish Google Cloud
topicId topicWeight
[(1, 0.106), (2, 0.21), (10, 0.035), (11, 0.204), (47, 0.014), (56, 0.018), (61, 0.06), (77, 0.054), (79, 0.121), (94, 0.093)]
simIndex simValue blogId blogTitle
1 0.93288153 134 high scalability-2007-10-26-Paper: Wikipedia's Site Internals, Configuration, Code Examples and Management Issues
Introduction: Wikipedia and Wikimedia have some of the best, most complete real-world documentation on how to build highly scalable systems. This paper by Domas Mituzas covers a lot of details about how Wikipedia works, including: an overview of the different packages used (Linux, PowerDNS, LVS, Squid, lighttpd, Apache, PHP5, Lucene, Mono, Memcached), how they use their CDN, how caching works, how they profile their code, how they store their media, how they structure their database access, how they handle search, how they handle load balancing and administration. All with real code examples and examples of configuration files. This is a really useful resource. Related Articles Wikimedia Architecture Domas Mituzas' Blog
same-blog 2 0.8874923 1055 high scalability-2011-06-08-Stuff to Watch from Google IO 2011
Introduction: With the Google IO Developer Conference completed there are dozens and dozens of information packed videos now available. While you won't get any of the nifty free swag the attendees rake in, it's great of Google to make these videos available so quickly after the conference. Let's say you don't want to watch all the videos on the pretense you have a life, here are just a dozen scalability and architecture related videos you might find interesting: App Engine Backends by Justin Haugh, Greg Darke. One of this biggest complaints about GAE are the request deadlines. Those are now gone when you rent a new Backend node. Scaling App Engine Applications by Justin Haugh, Guido van Rossum. Two parts: how App Engine scales internally and how you as a programmer make it scale using the tools. Good discussion of scaling and why it's hard; 10,000 queries per second is a large app that needs good architecting; a good discussion of GAE's predictive scaling formula of how it decides w
Introduction: Snooze is an open-source, scalable, autonomic, and energy-efficient virtual machine (VM) management framework for private clouds. Similarly to other VM management frameworks such as Nimbus, OpenNebula, Eucalyptus, and OpenStack it allows to build compute infrastructures from virtualized resources. Particularly, once installed and configured users can submit and control the life-cycle of a large number of VMs. However, contrary to existing frameworks for scalability and fault tolerance, Snooze employs a self-organizing and healing (based on Apache ZooKeeper) hierarchical architecture. Moreover, it performs distributed VM management and is designed to be energy efficient. Therefore, it implements features to monitor and estimate VM resource (CPU, memory, network Rx, network Tx) demands, detect and resolve overload/underload situations, perform dynamic VM consolidation through live migration, and finally power management to save energy. Last but not least, it integrates a g
4 0.87800419 771 high scalability-2010-02-04-Hot Scalability Links for February 4, 2010
Introduction: Lots of cool stuff happening this week... Voldemort gets rebalancing. It's one thing to shard data to scale, it's a completely different level of functionality to manage those shards intelligently. Voldemort has stepped up by adding advanced rebalancing functionality: Dynamic addition of new nodes to the cluster; Deletion of nodes from cluster; Load balancing of data inside a cluster. Microsoft Finally Opens Azure for Business. Out of the blue Microsoft opens up their platform as a service service. Good to have more competition and we'll keep an eye out for experience reports. New details on LinkedIn architecture by Greg Linden. LinkedIn appears to only use caching minimally, preferring to spend their efforts and machine resources on making sure they can recompute computations quickly than on hiding poor performance behind caching layers . The end of SQL and relational databases? by David Intersimone . For new projects, I believe, we have genuine non-relational a
5 0.86229622 25 high scalability-2007-07-25-Paper: Designing Disaster Tolerant High Availability Clusters
Introduction: A very detailed (339 pages) paper on how to use HP products to create a highly available cluster. It's somewhat dated and obviously concentrates on HP products, but it is still good information. Table of contents: 1. Disaster Tolerance and Recovery in a Serviceguard Cluster 2. Building an Extended Distance Cluster Using ServiceGuard 3. Designing a Metropolitan Cluster 4. Designing a Continental Cluster 5. Building Disaster-Tolerant Serviceguard Solutions Using Metrocluster with Continuous Access XP 6. Building Disaster Tolerant Serviceguard Solutions Using Metrocluster with EMC SRDF 7. Cascading Failover in a Continental Cluster Evaluating the Need for Disaster Tolerance What is a Disaster Tolerant Architecture? Types of Disaster Tolerant Clusters Extended Distance Clusters Metropolitan Cluster Continental Cluster Continental Cluster With Cascading Failover Disaster Tolerant Architecture Guidelines Protecting Nodes through Geographic Dispersion Protecting Data th
6 0.85169941 668 high scalability-2009-08-01-15 Scalability and Performance Best Practices
7 0.84301412 105 high scalability-2007-10-01-Statistics Logging Scalability
8 0.82854635 136 high scalability-2007-10-28-Scaling Early Stage Startups
9 0.82724154 1236 high scalability-2012-04-30-Masstree - Much Faster than MongoDB, VoltDB, Redis, and Competitive with Memcached
10 0.82447779 908 high scalability-2010-09-28-6 Strategies for Scaling BBC iPlayer
11 0.8084324 303 high scalability-2008-04-18-Scaling Mania at MySQL Conference 2008
12 0.80515921 765 high scalability-2010-01-25-Let's Welcome our Neo-Feudal Overlords
13 0.80477583 1516 high scalability-2013-09-13-Stuff The Internet Says On Scalability For September 13, 2013
14 0.80213344 119 high scalability-2007-10-10-WAN Accelerate Your Way to Lightening Fast Transfers Between Data Centers
15 0.7988652 517 high scalability-2009-02-21-Google AppEngine - A Second Look
16 0.79754066 1117 high scalability-2011-09-16-Stuff The Internet Says On Scalability For September 16, 2011
17 0.79743409 72 high scalability-2007-08-22-Wikimedia architecture
18 0.79645985 789 high scalability-2010-03-05-Strategy: Planning for a Power Outage Google Style
19 0.79583627 1174 high scalability-2012-01-13-Stuff The Internet Says On Scalability For January 13, 2012
20 0.7950474 1402 high scalability-2013-02-07-Ask HighScalability: Web asset server concept - 3rd party software available?