high_scalability high_scalability-2012 high_scalability-2012-1212 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: When you’re looking to add new tank mates to an existing aquarium ecosystem, one of the concerns you must have is whether a particular breed of fish is amenable to conspecific cohabitants. Many species are not, which means if you put them together in a confined space, they’re going to fight. Viciously. To the death. Responsible aquarists try to avoid such situations, so careful attention to the conspecificity of animals is a must. Now, while in many respects the data center ecosystem correlates well to an aquarium ecosystem, in this case it does not. It’s what you usually get, today, but its not actually the best model. That’s because what you want in the data center ecosystem – particularly when it extends to include public cloud computing resources – is conspecificity in infrastructure. This desire and practice is being seen both in enterprise data center decision making as well as in startups suddenly dealing with massive growth and increasingly encountering pe
sentIndex sentText sentNum sentScore
1 When you’re looking to add new tank mates to an existing aquarium ecosystem, one of the concerns you must have is whether a particular breed of fish is amenable to conspecific cohabitants. [sent-1, score-0.667]
2 Responsible aquarists try to avoid such situations, so careful attention to the conspecificity of animals is a must. [sent-5, score-0.176]
3 Now, while in many respects the data center ecosystem correlates well to an aquarium ecosystem, in this case it does not. [sent-6, score-0.405]
4 That’s because what you want in the data center ecosystem – particularly when it extends to include public cloud computing resources – is conspecificity in infrastructure. [sent-8, score-0.801]
5 This desire and practice is being seen both in enterprise data center decision making as well as in startups suddenly dealing with massive growth and increasingly encountering performance bottlenecks over which IT has no control to resolve. [sent-9, score-0.338]
6 OPERATIONAL CONSISTENCY One of the biggest negatives to a hybrid architectural approach to cloud computing is the lack of operational consistency . [sent-10, score-0.645]
7 While enterprise systems may be unified and managed via a common platform, resources and delivery services in the cloud are managed using very different systems and interfaces. [sent-11, score-0.428]
8 This poses a challenge for all of IT, but is particularly an impediment to those responsible for devops – for integrating and automating provisioning of the application delivery services required to support applications. [sent-12, score-0.389]
9 It requires diverse sets of skills – often those peculiar to developers such as programming and standards knowledge (SOAP, XML) – as well as those traditionally found in the data center. [sent-13, score-0.157]
10 ” – Allan Leinwand, Zynga’s Infrastructure CTO Other bottlenecks were found in the networks to storage systems, Internet traffic moving through Web servers, firewalls' ability to process the streams of traffic, and load balancers' ability to keep up with constantly shifting demand. [sent-17, score-0.234]
11 Zynga uses Citrix Systems CloudStack as its virtual machine management interface superimposed on all zCloud VMs, regardless of whether they're in the public cloud or private cloud . [sent-18, score-0.832]
12 Amazon security groups are not easily codified in enterprise-class systems, and vice-versa. [sent-20, score-0.08]
13 Thus if hybrid cloud is to become the architectural model of choice, it becomes necessary to unify operations across all environments – whether public or enterprise. [sent-22, score-1.053]
14 UNIFIED OPERATIONS We are seeing this demand more and more, as enterprise organizations seek out ways to integrate cloud-based resources into existing architectures to support a variety of business needs – disaster recover, business continuity, and spikes in application demand. [sent-23, score-0.377]
15 What customers are demanding is a unified approach to integrating those resources, which means infrastructure providers must be able to offer solutions that can be deployed both in a traditional enterprise-class model as well as a public cloud environment. [sent-24, score-1.056]
16 This ability to invoke and coordinate both private and public clouds is "the hidden jewel" of Zynga's success, says Allan Leinwand, CTO of infrastructure engineering at the company. [sent-26, score-0.487]
17 -- Lessons From FarmVille: How Zynga Uses The Cloud While much is made of Zynga’s “reverse cloud-bursting” business model, what seems to be grossly overlooked is the conspecificity of infrastructure required in order to move seamlessly between the two worlds. [sent-27, score-0.386]
18 Whether at the virtualization layer or at the delivery infrastructure layer, a consistent model of operations is a must to transparently take advantage of the business benefits inherent in a cross-environment, aka hybrid, cloud model of deployment. [sent-28, score-0.886]
19 As organizations converge on a hybrid model, they will continue to recognize the need and advantages of an operationally consistent model – and they are demanding it be supported. [sent-29, score-0.713]
wordName wordTfidf (topN-words)
[('zynga', 0.29), ('hybrid', 0.26), ('whether', 0.184), ('public', 0.181), ('aquarium', 0.176), ('conspecificity', 0.176), ('leinwand', 0.159), ('ecosystem', 0.156), ('model', 0.143), ('cloud', 0.143), ('allan', 0.143), ('infrastructure', 0.131), ('poses', 0.127), ('organizations', 0.12), ('demanding', 0.105), ('integrating', 0.103), ('private', 0.101), ('operational', 0.1), ('enterprise', 0.099), ('unified', 0.099), ('delivery', 0.087), ('bottlenecks', 0.086), ('consistent', 0.085), ('superimposed', 0.08), ('codification', 0.08), ('codified', 0.08), ('imposing', 0.08), ('peculiar', 0.08), ('tank', 0.08), ('jewel', 0.08), ('mates', 0.08), ('innate', 0.08), ('absorber', 0.08), ('cloudstack', 0.08), ('encountering', 0.08), ('business', 0.079), ('cto', 0.078), ('diverse', 0.077), ('providers', 0.076), ('must', 0.075), ('citrix', 0.075), ('zcloud', 0.075), ('govern', 0.075), ('ability', 0.074), ('center', 0.073), ('particularly', 0.072), ('unify', 0.072), ('negatives', 0.072), ('amenable', 0.072), ('architectural', 0.07)]
simIndex simValue blogId blogTitle
same-blog 1 1.0000005 1212 high scalability-2012-03-21-The Conspecific Hybrid Cloud
Introduction: When you’re looking to add new tank mates to an existing aquarium ecosystem, one of the concerns you must have is whether a particular breed of fish is amenable to conspecific cohabitants. Many species are not, which means if you put them together in a confined space, they’re going to fight. Viciously. To the death. Responsible aquarists try to avoid such situations, so careful attention to the conspecificity of animals is a must. Now, while in many respects the data center ecosystem correlates well to an aquarium ecosystem, in this case it does not. It’s what you usually get, today, but its not actually the best model. That’s because what you want in the data center ecosystem – particularly when it extends to include public cloud computing resources – is conspecificity in infrastructure. This desire and practice is being seen both in enterprise data center decision making as well as in startups suddenly dealing with massive growth and increasingly encountering pe
2 0.28450984 1044 high scalability-2011-05-19-Zynga's Z Cloud - Scale Fast or Fail Fast by Merging Private and Public Clouds
Introduction: Release early and often. A/B testing. Creating a landing page and buying ads on AdSense. All are ways of providing quick feedback in order to validate an idea. If you are like Zynga, with 250 million active users a month, how do you cost effectively prove out a game that could flop or get 90 million users (like CityVille) in an instant? Zynga handles this problem inlle an innovative way, by inverting the typical cloud burst scenario that has excess traffic flowing from a datacenter to a cloud, to having a game start in the cloud and then moving to the datacenter once the game has proved popular enough to keep. This process is nicely described by Charles Babcock in Lessons From FarmVille: How Zynga Uses The Cloud , in an interview with Allan Leinwand, CTO of infrastructure engineering at Zynga. When paired down to its essence, Zynga's strategy goes something like this: Games are risky . Even with all their experience, Zynga can't know how many people will play a game or how
3 0.1821553 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
Introduction: It remains that, from the same principles, I now demonstrate the frame of the System of the World. -- Isaac Newton The practice of IT reminds me a lot of the practice of science before Isaac Newton. Aristotelianism was dead, but there was nothing to replace it. Then Newton came along, created a scientific revolution with his System of the World . And everything changed. That was New System of the World number one. New System of the World number two was written about by the incomparable Neal Stephenson in his incredible Baroque Cycle series. It explores the singular creation of a new way of organizing society grounded in new modes of thought in business, religion, politics, and science. Our modern world emerged Enlightened as it could from this roiling cauldron of forces. In IT we may have had a Leonardo da Vinci or even a Galileo, but we’ve never had our Newton. Maybe we don't need a towering genius to make everything clear? For years startups, like the frenetically inventive
4 0.16572538 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
Introduction: This is a guest post by Frédéric Faure (architect at Ysance ) on the differences between using a cloud infrastructure and building your own. Frédéric was kind enough to translate the original French version of this article into English. I’ve been noticing many questions about the differences inherent in choosing between a Cloud infrastructure such as AWS (Amazon Web Services) and a traditional physical infrastructure. Firstly, there are a certain number of preconceived notions on this subject that I will attempt to decode for you. Then, it must be understood that each infrastructure has its advantages and disadvantages: a Cloud-type infrastructure does not necessarily fulfill your requirements in every case, however, it can satisfy some of them by optimizing or facilitating the features offered by a traditional physical infrastructure. I will therefore demonstrate the differences between the two that I have noticed, in order to help you make up your own mind. The Fram
5 0.16303557 924 high scalability-2010-10-21-What is Network-based Application Virtualization and Why Do You Need It?
Introduction: With all the attention being paid these days to VDI (virtual desktop infrastructure) and application virtualization and server virtualization andvirtualization it’s easy to forget about network-based application virtualization. But it’s the one virtualization technique you shouldn’t forget because it is a foundational technology upon which myriad other solutions will be enabled. WHAT IS NETWORK-BASED APPLICATION VIRTUALIZATION? This term may not be familiar to you but that’s because since its inception oh, more than a decade ago, it’s always just been called “server virtualization”. After the turn of the century (I love saying that, by the way) it was always referred to as service virtualization in SOA and XML circles. With the rise of the likes of VMware and Citrix and Microsoft server virtualization solutions, it’s become impossible to just use the term “server virtualization” and “service virtualization” is just as ambiguous so it seems appropriate to giv
6 0.15736756 444 high scalability-2008-11-14-Private-Public Cloud
7 0.15535837 754 high scalability-2009-12-22-Incremental deployment
8 0.15087079 1157 high scalability-2011-12-14-Virtualization and Cloud Computing is Changing the Network to East-West Routing
11 0.13801397 706 high scalability-2009-09-16-The VeriScale Architecture - Elasticity and efficiency for private clouds
12 0.12816918 918 high scalability-2010-10-12-The CIO’s Problem: Cloud “Mess” or Cloud “Mash”
13 0.1272188 755 high scalability-2009-12-28-Zynga Needs a Server-side Systems Engineer
18 0.11697952 1264 high scalability-2012-06-15-Cloud Bursting between AWS and Rackspace
19 0.11630309 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
20 0.11628307 1654 high scalability-2014-06-05-Cloud Architecture Revolution
topicId topicWeight
[(0, 0.202), (1, 0.021), (2, 0.094), (3, 0.1), (4, -0.085), (5, -0.054), (6, 0.028), (7, -0.132), (8, -0.034), (9, -0.001), (10, 0.017), (11, 0.102), (12, -0.06), (13, 0.026), (14, -0.042), (15, 0.017), (16, 0.084), (17, -0.015), (18, 0.036), (19, -0.014), (20, 0.014), (21, 0.027), (22, 0.011), (23, 0.012), (24, 0.035), (25, 0.077), (26, -0.062), (27, -0.02), (28, -0.016), (29, -0.022), (30, 0.058), (31, 0.027), (32, -0.041), (33, -0.002), (34, -0.003), (35, 0.075), (36, 0.018), (37, -0.015), (38, 0.02), (39, -0.019), (40, -0.036), (41, 0.047), (42, -0.028), (43, 0.063), (44, -0.039), (45, -0.005), (46, -0.01), (47, -0.057), (48, 0.038), (49, -0.002)]
simIndex simValue blogId blogTitle
same-blog 1 0.97750801 1212 high scalability-2012-03-21-The Conspecific Hybrid Cloud
Introduction: When you’re looking to add new tank mates to an existing aquarium ecosystem, one of the concerns you must have is whether a particular breed of fish is amenable to conspecific cohabitants. Many species are not, which means if you put them together in a confined space, they’re going to fight. Viciously. To the death. Responsible aquarists try to avoid such situations, so careful attention to the conspecificity of animals is a must. Now, while in many respects the data center ecosystem correlates well to an aquarium ecosystem, in this case it does not. It’s what you usually get, today, but its not actually the best model. That’s because what you want in the data center ecosystem – particularly when it extends to include public cloud computing resources – is conspecificity in infrastructure. This desire and practice is being seen both in enterprise data center decision making as well as in startups suddenly dealing with massive growth and increasingly encountering pe
2 0.83907825 918 high scalability-2010-10-12-The CIO’s Problem: Cloud “Mess” or Cloud “Mash”
Introduction: Loved those mainframe days – you only needed one, but then came along the AS400’s and soon you had ten – but wait, you needed client server and SOA, oh sh%# – now I have ten thousand servers and I need to consolidate server and datacenter operations! Is Cloud Computing going to follow the same path? As a technology strategist I have the benefit of frequently speaking with other CIO’s on the topic of Cloud Computing. Often those discussions are in context to how they can leverage SpringCM’ s easy, fast and affordable cloud Enterprise Content Management (ECM) services. But those conversations are done in context to the overall strategy and reality that the modern CIO will use a combination of cloud offerings to solve business problems today. Some of those services will be internally provided (Private Cloud), and many more will be outside the traditional corporate domain, also known as Public Cloud services. What options do I have? In a recent conversation with a CIO represen
3 0.81595582 444 high scalability-2008-11-14-Private-Public Cloud
Introduction: Data centers are reshaping themselves by taking ideas from public cloud providers, such as Amazon and Google. The idea is to make the data center more cost-effective by enabling on-demand utility-based computing rather than dedicated machines. At the same time, it is clear that to make IT operations more effective, it doesn't make sense to run all the applications that are currently hosted in a company's data center in the private cloud. This calls for an integration between private and public cloud. In this post i discuss some of the challenges involved in making that happen: 1. How do we design applications to be cloud-agnostic? 2. How do we enable seamless fail-over to a public cloud? 3. Future-proofing: There are many cases in which we can't make a clear decision as to where our application should be running at the time of writing or developing the application. We would like to be in a position to change the decision as to where our application will be running even after o
4 0.80965585 1184 high scalability-2012-01-31-Performance in the Cloud: Business Jitter is Bad
Introduction: One of the benefits of web applications is that they are generally transported via TCP, which is a connection-oriented protocol designed to assure delivery. TCP has a variety of native mechanisms through which delivery issues can be addressed – from window sizes to selective acks to idle time specification to ramp up parameters. All these technical knobs and buttons serve as a way for operators and administrators to tweak the protocol, often at run time, to ensure the exchange of requests and responses upon which web applications rely. This is unlike UDP, which is more of a “fire and forget” protocol in which the server doesn’t really care if you receive the data or not. Now, voice and streaming video and audio over the web has always leveraged UDP and thus it has always been highly sensitive to jitter. Jitter is, without getting into layer one (physical) jargon, an undesirable delay in the otherwise consistent delivery of packets. It causes the delay of and sometimes
5 0.79788446 706 high scalability-2009-09-16-The VeriScale Architecture - Elasticity and efficiency for private clouds
Introduction: The modern datacenter is evolving into the network centric datacenter model, which is applied to both public and private cloud computing. In this model, networking, platform, storage, and software infrastructure are provided as services that scale up or down on demand. The network centric model allows the datacenter to be viewed as a collection of automatically deployed and managed application services that utilize underlying virtualized services. Providing sufficient elasticity and scalability for the rapidly growing needs of the datacenter requires these collections of automatically-managed services to scale efficiently and with essentially no limits, letting services adapt easily to changing requirements and workloads. Sun’s VeriScale architecture provides the architectural platform that can deliver these capabilities. Sun Microsystems has been developing open and modular infrastructure architectures for more than a decade. The features of these architectures, such as elasticity, ar
6 0.79341084 1264 high scalability-2012-06-15-Cloud Bursting between AWS and Rackspace
7 0.79301465 1354 high scalability-2012-11-05-Are we seeing the renaissance of enterprises in the cloud?
8 0.76407504 762 high scalability-2010-01-18-The Missing Piece in the Virtualization Stack (Part 1)
9 0.76147729 388 high scalability-2008-09-23-Event: CloudCamp Silicon Valley Unconference on 30th September
10 0.75743324 1006 high scalability-2011-03-17-Are long VM instance spin-up times in the cloud costing you money?
12 0.75207341 803 high scalability-2010-04-05-Intercloud: How Will We Scale Across Multiple Clouds?
13 0.74842125 1654 high scalability-2014-06-05-Cloud Architecture Revolution
14 0.74625468 490 high scalability-2009-01-12-Getting ready for the cloud
15 0.7423473 1056 high scalability-2011-06-09-Retrospect on recent AWS outage and Resilient Cloud-Based Architecture
16 0.74194074 524 high scalability-2009-03-04-Its time for auto scaling – avoid peak load provisioning for web applications
17 0.73436332 1002 high scalability-2011-03-09-Productivity vs. Control tradeoffs in PaaS
18 0.73371166 567 high scalability-2009-04-14-Challanges for Developing Enterprise Application on the Cloud
19 0.73235947 1144 high scalability-2011-11-17-Five Misconceptions on Cloud Portability
20 0.73030782 853 high scalability-2010-07-08-Cloud AWS Infrastructure vs. Physical Infrastructure
topicId topicWeight
[(1, 0.151), (2, 0.22), (4, 0.011), (10, 0.045), (30, 0.017), (61, 0.102), (76, 0.016), (77, 0.012), (79, 0.067), (85, 0.03), (94, 0.06), (96, 0.194)]
simIndex simValue blogId blogTitle
1 0.93408573 281 high scalability-2008-03-18-Database Design 101
Introduction: I am working on the design for my database and can't seem to come up with a firm schema. I am torn between normalizing the data and dealing with the overhead of joins and denormalizing it for easy sharding. The data is essentially music information per user: UserID, Artist, Album, Song. This lends itself nicely to be normalized and have separate User, Artist, Album and Song databases with a table full of INTs to tie them together. This will be in a mostly read based environment and with about 80% being searches of data by artist album or song. By the time I begin the query for artist, album or song I will already have a list of UserID's to limit the search by. The problem is that the tables can get unmanageably large pretty quickly and my plan was to shard off users once it got too big. Given this simple data relationship what are the pros and cons of normalizing the data vs denormalizing it? Should I go with 4 separate, normalized tables or one 4 column table? Perhaps it might
2 0.92188567 1549 high scalability-2013-11-15-Stuff The Internet Says On Scalability For November 15th, 2013
Introduction: Hey, it's HighScalability time: Test your sense of scale. Is this image of something microscopic or macroscopic? Find out . Quotable Quotes: fidotron : It feels like we've gone in one big circle, where first we move the DB on to a separate machine for performance, yet now more computation will go back to being done nearer the data (like Hadoop) and we'll try to pretend it's all just one giant computer again. @pbailis : Building systems from the ground up with distribution, scale, and availability in mind is much easier than retrofitting single-node systems. @merv : #awsreinvent Jassy: Netflix has 10,000s of EC2 instances. They are the final deployment scenario: All In. And others are coming. Edward Capriolo : YARN... Either it is really complicated or I have brain damage @djspiewak : Eventually, Node.js will reinvent the “IO promise” and realize that flattening your callback effects is actually quite nice. @jimblomo : A Note on Dis
3 0.92063355 1528 high scalability-2013-10-07-Ask HS: Is Microsoft the Right Technology for a Scalable Web-based System?
Introduction: This question was asked over email and I thought a larger audience might want to take a whack at it. I have a problem I’d like to have your view on. I’ve looked around a lot, and I haven’t found a definite answer. The question is this: Is it true that for a scalable web-based system targeting millions of users (hopefully), using Microsoft technology(.Net/SQL Server) over open source technologies like python/ruby/php and mysql (mariadb) / postgresql will cost you more? Is there any justification for paying up for Microsoft licenses(OS, SQL Server, …)? I am in charge of selecting the technology toolbox for a startup which is going to build a scalable public web platform. I’ve worked as a developer and database developer/admin (mainly as a DBA) using different platforms and technologies, but my main focus is on Microsoft technology. I’ve considered all other important factors for this decision, and at the end, I always come back to the question of money. When I finish developing th
4 0.91675496 348 high scalability-2008-07-09-Federation at Flickr: Doing Billions of Queries Per Day
Introduction: Flickr's lone database guy Dathan Pattishall made his excellent presentation available on how on how Flickr scales its backend to handle tremendous loads. Some of this information is available in Flickr Architecture , but the paper is so good it's worth another read. If you want to see sharding done right, at scale, take a look.
5 0.91322601 868 high scalability-2010-07-30-Basho Lives up to their Name With Consistent Smashing
Introduction: For some Friday Fun nerd style, I thought this demonstration from Basho on the difference between single master, sharding, and consistent smashing was really clever. I love the use of safety glasses! And it's harder to crash a server with a hammer than you might think... Recommended reading: http://labs.google.com/papers/bigtable.html http://research.yahoo.com/project/212
same-blog 6 0.90750557 1212 high scalability-2012-03-21-The Conspecific Hybrid Cloud
7 0.90045863 162 high scalability-2007-11-20-what is j2ee stack
8 0.8962152 422 high scalability-2008-10-17-Scaling Spam Eradication Using Purposeful Games: Die Spammer Die!
9 0.89343715 1052 high scalability-2011-06-03-Stuff The Internet Says On Scalability For June 3, 2011
10 0.8884905 435 high scalability-2008-10-30-The case for functional decomposition
11 0.88803136 828 high scalability-2010-05-17-7 Lessons Learned While Building Reddit to 270 Million Page Views a Month
12 0.88777483 1228 high scalability-2012-04-16-Instagram Architecture Update: What’s new with Instagram?
13 0.88468307 397 high scalability-2008-09-28-Product: Happy = Hadoop + Python
14 0.88032657 1035 high scalability-2011-05-05-Paper: A Study of Practical Deduplication
15 0.87342685 117 high scalability-2007-10-08-Paper: Understanding and Building High Availability-Load Balanced Clusters
16 0.85400677 1473 high scalability-2013-06-10-The 10 Deadly Sins Against Scalability
17 0.84652448 1609 high scalability-2014-03-11-Building a Social Music Service Using AWS, Scala, Akka, Play, MongoDB, and Elasticsearch
18 0.83757454 351 high scalability-2008-07-16-The Mother of All Database Normalization Debates on Coding Horror
19 0.83392239 1123 high scalability-2011-09-23-The Real News is Not that Facebook Serves Up 1 Trillion Pages a Month…
20 0.83315903 1221 high scalability-2012-04-03-Hazelcast 2.0: Big Data In-Memory