high_scalability high_scalability-2009 high_scalability-2009-702 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: How many times have you been called in the middle of the night by your operation guys telling you that your application throws some odd red alerts? How many times did you found out that when those issues happens you don't have enough information to analyze this incident? have you tried to increase the log level just to find out that your problem became even worse - now your application throws tons of information in a continues basis most of which is complete garbage... The current separation between the way we implement our application and the way we manage it leads to many of this ridicules situations. Cloud makes those things even worse. In this post i suggest an alternative approach. Why don't we run our application the way we run our business? I refer to this approach as the "interactive cloud" where our application behaves just like our project team and the operations just like our managers. As with our business our application would need to take more responsibility to the wa
sentIndex sentText sentNum sentScore
1 How many times have you been called in the middle of the night by your operation guys telling you that your application throws some odd red alerts? [sent-1, score-1.535]
2 How many times did you found out that when those issues happens you don't have enough information to analyze this incident? [sent-2, score-0.435]
3 have you tried to increase the log level just to find out that your problem became even worse - now your application throws tons of information in a continues basis most of which is complete garbage. [sent-3, score-1.327]
4 The current separation between the way we implement our application and the way we manage it leads to many of this ridicules situations. [sent-6, score-0.824]
5 In this post i suggest an alternative approach. [sent-8, score-0.219]
6 Why don't we run our application the way we run our business? [sent-9, score-0.485]
7 I refer to this approach as the "interactive cloud" where our application behaves just like our project team and the operations just like our managers. [sent-10, score-0.536]
8 As with our business our application would need to take more responsibility to the way it runs and take corrective actions such as balancing it own resources, re-assign tasks to the available resources in case of failure etc. [sent-11, score-1.278]
9 It will need to involve its manager only when it runs out of resource. [sent-12, score-0.413]
10 It will need to provide reports in a way that makes sense to our managers. [sent-13, score-0.427]
11 In the first part of this post describes the general concept behind this model and the second part provides technical background which include code snippet based on our experience in GigaSpaces. [sent-14, score-0.651]
wordName wordTfidf (topN-words)
[('throws', 0.371), ('posti', 0.215), ('behaves', 0.215), ('corrective', 0.192), ('application', 0.177), ('snippet', 0.175), ('tons', 0.17), ('odd', 0.16), ('way', 0.16), ('incident', 0.157), ('separation', 0.144), ('refer', 0.144), ('runs', 0.139), ('suggest', 0.127), ('involve', 0.124), ('telling', 0.121), ('red', 0.121), ('responsibility', 0.117), ('resources', 0.116), ('actions', 0.115), ('middle', 0.113), ('worse', 0.112), ('continues', 0.112), ('gigaspaces', 0.111), ('night', 0.107), ('guys', 0.106), ('business', 0.106), ('reports', 0.102), ('describes', 0.102), ('leads', 0.101), ('became', 0.1), ('interactive', 0.099), ('basis', 0.099), ('tried', 0.098), ('background', 0.098), ('times', 0.097), ('concept', 0.094), ('alternative', 0.092), ('alerts', 0.092), ('analyze', 0.091), ('part', 0.091), ('makes', 0.09), ('information', 0.088), ('many', 0.082), ('tasks', 0.081), ('operation', 0.08), ('happens', 0.077), ('manager', 0.075), ('need', 0.075), ('run', 0.074)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999994 702 high scalability-2009-09-11-The interactive cloud
Introduction: How many times have you been called in the middle of the night by your operation guys telling you that your application throws some odd red alerts? How many times did you found out that when those issues happens you don't have enough information to analyze this incident? have you tried to increase the log level just to find out that your problem became even worse - now your application throws tons of information in a continues basis most of which is complete garbage... The current separation between the way we implement our application and the way we manage it leads to many of this ridicules situations. Cloud makes those things even worse. In this post i suggest an alternative approach. Why don't we run our application the way we run our business? I refer to this approach as the "interactive cloud" where our application behaves just like our project team and the operations just like our managers. As with our business our application would need to take more responsibility to the wa
2 0.11931542 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
Introduction: It remains that, from the same principles, I now demonstrate the frame of the System of the World. -- Isaac Newton The practice of IT reminds me a lot of the practice of science before Isaac Newton. Aristotelianism was dead, but there was nothing to replace it. Then Newton came along, created a scientific revolution with his System of the World . And everything changed. That was New System of the World number one. New System of the World number two was written about by the incomparable Neal Stephenson in his incredible Baroque Cycle series. It explores the singular creation of a new way of organizing society grounded in new modes of thought in business, religion, politics, and science. Our modern world emerged Enlightened as it could from this roiling cauldron of forces. In IT we may have had a Leonardo da Vinci or even a Galileo, but we’ve never had our Newton. Maybe we don't need a towering genius to make everything clear? For years startups, like the frenetically inventive
Introduction: Who's Hiring? Apple is hiring a Senior Engineer in their Mobile Services team. We seek an accomplished server-side engineer capable of delivering an extraordinary portfolio of features and services based on emerging technologies to our internal customers. Please apply here . Apple is hiring a Software Engineer in their Messaging Services team. We build the cloud systems that power some of the busiest applications in the world, including iMessage, FaceTime and Apple Push Notifications. You'll have the opportunity to explore a wide range of technologies, developing the server software that is driving the future of messaging and mobile services. Please apply here . Apple is hiring an Enterprise Software Engineer. Apple's Emerging Technology Services group provides a Java based SOA platform for various applications to interact with each other. The platform is designed to handle millions of messages a day with very low latency. We have an immediate opening for a
4 0.10743973 654 high scalability-2009-07-09-No to SQL? Anti-database movement gains steam – My Take
Introduction: In this post i wrote my view on the anti SQL database movement and where the alternative approach fits in: - SQL databases are not going away anytime soon. - The current "one size fit it all" databases thinking was and is wrong. - There is definitely a place for a more a more specialized data management solutions alongside traditional SQL databases. In addition to the options that was mentioned on the original article i pointed out the the in-memory alternative approach and how that fits into the puzzle. I used a real life scenario: scalable Social network based eCommerce site where i outlined how in-memory approach was the only option they could scale and meet their application performance and response time requirements.
5 0.10662133 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
Introduction: We are on the edge of two potent technological changes: Clouds and Memory Based Architectures. This evolution will rip open a chasm where new players can enter and prosper. Google is the master of disk. You can't beat them at a game they perfected. Disk based databases like SimpleDB and BigTable are complicated beasts, typical last gasp products of any aging technology before a change. The next era is the age of Memory and Cloud which will allow for new players to succeed. The tipping point will be soon. Let's take a short trip down web architecture lane: It's 1993: Yahoo runs on FreeBSD, Apache, Perl scripts and a SQL database It's 1995: Scale-up the database. It's 1998: LAMP It's 1999: Stateless + Load Balanced + Database + SAN It's 2001: In-memory data-grid. It's 2003: Add a caching layer. It's 2004: Add scale-out and partitioning. It's 2005: Add asynchronous job scheduling and maybe a distributed file system. It's 2007: Move it all into the cloud. It's 2008: C
6 0.10569023 746 high scalability-2009-11-26-Kngine Snippet Search New Indexing Technology
9 0.097100385 924 high scalability-2010-10-21-What is Network-based Application Virtualization and Why Do You Need It?
10 0.092939653 1056 high scalability-2011-06-09-Retrospect on recent AWS outage and Resilient Cloud-Based Architecture
11 0.086204365 761 high scalability-2010-01-17-Applications Become Black Boxes Using Markets to Scale and Control Costs
12 0.085979924 1508 high scalability-2013-08-28-Sean Hull's 20 Biggest Bottlenecks that Reduce and Slow Down Scalability
13 0.085405633 219 high scalability-2008-01-21-Product: Hyperic
14 0.084918208 1654 high scalability-2014-06-05-Cloud Architecture Revolution
16 0.081204265 313 high scalability-2008-05-02-Friends for Sale Architecture - A 300 Million Page View-Month Facebook RoR App
18 0.079023615 906 high scalability-2010-09-22-Applying Scalability Patterns to Infrastructure Architecture
19 0.078699343 933 high scalability-2010-11-01-Hot Trend: Move Behavior to Data for a New Interactive Application Architecture
20 0.078241162 920 high scalability-2010-10-15-Troubles with Sharding - What can we learn from the Foursquare Incident?
topicId topicWeight
[(0, 0.162), (1, 0.036), (2, 0.031), (3, 0.013), (4, -0.021), (5, -0.031), (6, 0.04), (7, -0.039), (8, -0.033), (9, -0.008), (10, -0.02), (11, 0.079), (12, -0.02), (13, -0.01), (14, 0.028), (15, -0.043), (16, 0.017), (17, -0.049), (18, 0.028), (19, 0.014), (20, 0.013), (21, -0.036), (22, 0.004), (23, 0.066), (24, 0.05), (25, 0.011), (26, -0.072), (27, -0.014), (28, -0.0), (29, 0.023), (30, -0.026), (31, -0.013), (32, 0.04), (33, 0.003), (34, -0.013), (35, 0.02), (36, -0.039), (37, -0.048), (38, 0.02), (39, -0.041), (40, -0.035), (41, -0.001), (42, 0.014), (43, 0.004), (44, 0.004), (45, 0.005), (46, 0.021), (47, 0.025), (48, 0.02), (49, -0.069)]
simIndex simValue blogId blogTitle
same-blog 1 0.96956849 702 high scalability-2009-09-11-The interactive cloud
Introduction: How many times have you been called in the middle of the night by your operation guys telling you that your application throws some odd red alerts? How many times did you found out that when those issues happens you don't have enough information to analyze this incident? have you tried to increase the log level just to find out that your problem became even worse - now your application throws tons of information in a continues basis most of which is complete garbage... The current separation between the way we implement our application and the way we manage it leads to many of this ridicules situations. Cloud makes those things even worse. In this post i suggest an alternative approach. Why don't we run our application the way we run our business? I refer to this approach as the "interactive cloud" where our application behaves just like our project team and the operations just like our managers. As with our business our application would need to take more responsibility to the wa
2 0.77643633 1301 high scalability-2012-08-08-3 Tips and Tools for Creating Reliable Billion Page View Web Services
Introduction: Amir Salihefendic, founder of Todoist and Wedoist, in How to create very reliable web services , has written an insightful post on strategies for creating reliable web services along with the tools needed to make it happen. Realtime monitor everything . Create a clear picture of what's going on at any time both past and present. Keep a log of errors and key application metrics. Visualize response times and other metrics for every computer in your network. Tools: statsd , Graphite , Pingdom , Cacti , Nagios . Be proactive . Don't optimize prematurely, but don't wait to optimize when in a crisis situation. Anticipate problems before they happen by monitoring and completely understanding your system. Think now about how to scale your system if load increases by several orders of magnitude. Be notified when crashes happen . Use tools like Pingdom and crash_hound to send notifications when problems do occur. While not
3 0.74484169 977 high scalability-2011-01-21-PaaS shouldn’t be built in Silos
Introduction: Unlike many of the existing Platforms, in this second-generation phase, its not going to be enough to package and bundle different individual middleware services and products (Web Containers, Messaging, Data, Monitoring, Automation and Control, Provisioning) and brand them under the same name to make them look as one. (Fusion? Fabric? A rose is a rose by any other name - and in this case, it's not a rose.) The second-generation PaaS needs to come with a holistic approach that couples all those things together and provide a complete holistic experience. By that I mean that if I add a machine into cluster, I need to see that as an increase in capacity on my entire application stack, the monitoring system needs to discover that new machine and start monitoring it without any configuration setup, the load-balancer need to add it to its pool and so forth. Our challenge as technologists would be to move from our current siloed comfort zone. That applies not just to the way we design our
4 0.74376047 1628 high scalability-2014-04-08-Microservices - Not a free lunch!
Introduction: This is a guest post by Benjamin Wootton , CTO of Contino , a London based consultancy specialising in applying DevOps and Continuous Delivery to software delivery projects. Microservices are a style of software architecture that involves delivering systems as a set of very small, granular, independent collaborating services. Though they aren't a particularly new idea, Microservices seem to have exploded in popularity this year, with articles, conference tracks, and Twitter streams waxing lyrical about the benefits of building software systems in this style. This popularity is partly off the back of trends such as Cloud, DevOps and Continuous Delivery coming together as enablers for this kind of approach, and partly off the back of great work at companies such as Netflix who have very visibly applied the pattern to great effect. Let me say up front that I am a fan of the approach. Microservices architectures have lots of very real and significant benefits: The service
5 0.72738105 1031 high scalability-2011-04-28-PaaS on OpenStack - Run Applications on Any Cloud, Any Time Using Any Thing
Introduction: Yesterday, I had a session during the OpenStack Summit where I tried to present a more general view on how we should be thinking about PaaS in the context of OpenStack. The key takeaway : The main goal of PaaS is to drive productivity into the process by which we can deliver new applications. Most of the existing PaaS solutions take a fairly extreme approach with their abstraction of the underlying infrastructure and therefore fit a fairly small number of extremely simple applications and thus miss the real promise of PaaS. Amazon's Elastic Beanstalk took a more bottom up approach giving us better set of tradeoffs between the abstraction and control which makes it more broadly applicable to a larger set of applications. The fact that OpenStack is opensource allows us to think differently on the things we can do at the platform layer. We can create a tighter integration between the PaaS and IaaS layers and thus come up with better set of tradeoffs into the way we drive
6 0.71565795 428 high scalability-2008-10-24-11 Secrets of a Cloud Scale Consultant That They Dont' Want You to Know
7 0.70846736 1184 high scalability-2012-01-31-Performance in the Cloud: Business Jitter is Bad
8 0.70036173 1354 high scalability-2012-11-05-Are we seeing the renaissance of enterprises in the cloud?
9 0.69990796 549 high scalability-2009-03-26-Performance - When do I start worrying?
10 0.69938052 1654 high scalability-2014-06-05-Cloud Architecture Revolution
11 0.69362527 762 high scalability-2010-01-18-The Missing Piece in the Virtualization Stack (Part 1)
12 0.68987572 1056 high scalability-2011-06-09-Retrospect on recent AWS outage and Resilient Cloud-Based Architecture
13 0.68787581 924 high scalability-2010-10-21-What is Network-based Application Virtualization and Why Do You Need It?
14 0.68485039 1087 high scalability-2011-07-26-Web 2.0 Killed the Middleware Star
16 0.67942858 524 high scalability-2009-03-04-Its time for auto scaling – avoid peak load provisioning for web applications
17 0.66984797 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
18 0.66745394 295 high scalability-2008-04-02-Product: Supervisor - Monitor and Control Your Processes
19 0.66680741 1260 high scalability-2012-06-07-Case Study on Scaling PaaS infrastructure
20 0.65902597 250 high scalability-2008-02-17-Web Accelerators - snake oil or miracle remedy?
topicId topicWeight
[(1, 0.134), (2, 0.175), (10, 0.034), (31, 0.239), (61, 0.123), (79, 0.175), (85, 0.021)]
simIndex simValue blogId blogTitle
1 0.8987208 1651 high scalability-2014-05-20-It's Networking. In Space! Or How E.T. Will Phone Home.
Introduction: What will the version of the Internet that follows us to the stars look like? Yes, people are really thinking seriously about this sort of thing. Specifically the InterPlanetary Networking Special Interest Group (IPNSIG). Ansible-like faster-than-light communication it isn't. There's no magical warp drive. Nor is a network of telepaths acting as a 'verse spanning telegraph system. It's more mundane than that. And in many ways more interesting as it's sort of like the old Internet on steroids, the one that was based on on UUCP and dial-up connections, but over vastly longer distances and with much longer delays : The Interplanetary Internet (based on IPN, also called InterPlaNet) is a conceived computer network in space, consisting of a set of network nodes which can communicate with each other.[1][2] Communication would be greatly delayed by the great interplanetary distances, so the IPN needs a new set of protocols and technology that are tolerant to large delays and
2 0.87546581 368 high scalability-2008-08-17-Wuala - P2P Online Storage Cloud
Introduction: How do you design a reliable distributed file system when the expected availability of the individual nodes are only ~1/5? That is the case for P2P systems. Dominik Grolimund, the founder of a Swiss startup Caleido will show you how! They have launched Wuala , the social online storage service which scales as new nodes join the P2P network. The goal of Wua.la is to provide distributed online storage that is: large scalable reliable secure by harnessing the idle resources of participating computers. This challenge is an old dream of computer science. In fact as Andrew Tanenbaum wrote in 1995: "The design of a world-wide, fully transparent distributed filesystem fot simultaneous use by millions of mobile and frequently disconnected users is left as an exercise for the reader" After three years of research and development at at ETH Zurich, the Swiss Federal Institute of Technology on a distributed storage system, Caleido is ready to unveil the resu
same-blog 3 0.87120908 702 high scalability-2009-09-11-The interactive cloud
Introduction: How many times have you been called in the middle of the night by your operation guys telling you that your application throws some odd red alerts? How many times did you found out that when those issues happens you don't have enough information to analyze this incident? have you tried to increase the log level just to find out that your problem became even worse - now your application throws tons of information in a continues basis most of which is complete garbage... The current separation between the way we implement our application and the way we manage it leads to many of this ridicules situations. Cloud makes those things even worse. In this post i suggest an alternative approach. Why don't we run our application the way we run our business? I refer to this approach as the "interactive cloud" where our application behaves just like our project team and the operations just like our managers. As with our business our application would need to take more responsibility to the wa
4 0.8632499 207 high scalability-2008-01-10-Sharding with Cookie-Based Session Storage
Introduction: In a recent project, I utilized RoR's cookie-based session storage to shard geographically distinct user groups. My technique for doing so was unique and, although it was a premature optimization, it is none-the-less an idea worth exploring.
5 0.83265555 785 high scalability-2010-02-26-MySQL and Memcached: End of an Era?
Introduction: If you look at the early days of this blog, when web scalability was still in its heady bloom of youth, many of the articles had to do with leveraging MySQL and memcached . Exciting times. Shard MySQL to handle high write loads, cache objects in memcached to handle high read loads, and then write a lot of glue code to make it all work together. That was state of the art, that was how it was done. The architecture of many major sites still follow this pattern today, largely because with enough elbow grease, it works. This was a pre-cloud, relational database dominated world, built from parts scrounged from the remnants of enterprises and datacenters past. Twitter and Digg started in this era, but are evolving into something different, as scaling pressures increase and new purpose built technologies pop into being. With a little perspective, it's clear the MySQL+memcached era is passing. It will stick around for a while. Old technologies seldom fade away completely. Some still
6 0.82613885 294 high scalability-2008-04-01-How to update video views count effectively?
7 0.81844157 615 high scalability-2009-06-01-HotPads on AWS
8 0.80903834 1255 high scalability-2012-06-01-Stuff The Internet Says On Scalability For June 1, 2012
9 0.78519487 888 high scalability-2010-08-27-OpenStack - The Answer to: How do We Compete with Amazon?
10 0.77263582 129 high scalability-2007-10-23-Hire Facebook, Ning, and Salesforce to Scale for You
11 0.77127802 733 high scalability-2009-10-29-Paper: No Relation: The Mixed Blessings of Non-Relational Databases
12 0.76962364 972 high scalability-2011-01-11-Google Megastore - 3 Billion Writes and 20 Billion Read Transactions Daily
13 0.76927292 1535 high scalability-2013-10-21-Google's Sanjay Ghemawat on What Made Google Google and Great Big Data Career Advice
14 0.76857126 687 high scalability-2009-08-24-How Google Serves Data from Multiple Datacenters
15 0.76772422 1242 high scalability-2012-05-09-Cell Architectures
16 0.76729941 763 high scalability-2010-01-22-How BuddyPoke Scales on Facebook Using Google App Engine
17 0.76726133 1292 high scalability-2012-07-27-Stuff The Internet Says On Scalability For July 27, 2012
19 0.76711887 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
20 0.76701581 590 high scalability-2009-05-06-Art of Distributed