high_scalability high_scalability-2008 high_scalability-2008-424 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Sorry, the content for this post apparently did not make the transition from the old HighScalability website, it's all messed up, but there's still a some useful content... EVE Online is "The World's Largest Game Universe", a massively multiplayer online game ( MMO ) made by CCP. EVE Online's Architecture is unusual for a MMOG because it doesn't divide the player load among different servers or shards. Instead, the same cluster handles the entire EVE universe. It is an interesting to compare this with the Architecture of the Second Life Grid . How do they manage to scale? Information Sources EVE Insider Dev Blog EVE Online FAQ Massively - Eve Evolved: Eve Online's Server Model and its discussion on Slashdot EVE Online Forums Massively Multiplayer Game Development 2 Platform Stackless Python used for both server and client game logic. It allows programmers to reap the benefits of thread-based programming without the performance and complexity p
sentIndex sentText sentNum sentScore
1 Sorry, the content for this post apparently did not make the transition from the old HighScalability website, it's all messed up, but there's still a some useful content. [sent-1, score-0.207]
2 EVE Online is "The World's Largest Game Universe", a massively multiplayer online game ( MMO ) made by CCP. [sent-4, score-0.615]
3 EVE Online's Architecture is unusual for a MMOG because it doesn't divide the player load among different servers or shards. [sent-5, score-0.293]
4 Instead, the same cluster handles the entire EVE universe. [sent-6, score-0.071]
5 It is an interesting to compare this with the Architecture of the Second Life Grid . [sent-7, score-0.048]
6 It allows programmers to reap the benefits of thread-based programming without the performance and complexity problems associated with conventional threads. [sent-10, score-0.194]
7 The cluster is divided across 90 - 100 SOL blades which run 2 nodes each. [sent-13, score-0.35]
8 A node is the primarily CPU intensive EVE server process running on one core. [sent-14, score-0.047]
9 There are some SOL blades dedicated to one busy solar systems such as Jita, Motsu and Saila. [sent-15, score-0.283]
10 Database Cluster - This is the persistence layer of EVE Online. [sent-16, score-0.05]
11 The running nodes interact heavily with the Database, and of course pretty much everything to do with the game lives here. [sent-17, score-0.425]
12 Thanks to Solid-state drives, the database is able to keep up with the enormous I/O load that Tranquility generates. [sent-18, score-0.063]
13 With innovative ideas MMO games can scale up to the hundreds of players in the same battle. [sent-19, score-0.117]
14 SSDs will in fact bridge the gap huge performance gap between the memory and disks to some extent. [sent-20, score-0.321]
15 Low latency Infiniband network interconnect will enable larger clusters. [sent-21, score-0.08]
16 Lessons Learned There are many interesting facts about the architecture of the EVE Online MMOG such as the use of Stackless Python and SSDs. [sent-22, score-0.063]
17 Check out the information sources for detailed insights to the development and operation of the EVE Online game. [sent-23, score-0.054]
wordName wordTfidf (topN-words)
[('eve', 0.661), ('mmog', 0.217), ('sol', 0.217), ('game', 0.212), ('online', 0.211), ('mmo', 0.185), ('blades', 0.16), ('player', 0.16), ('multiplayer', 0.144), ('gap', 0.129), ('learnedthere', 0.098), ('messed', 0.098), ('modeland', 0.098), ('reap', 0.088), ('thearchitecture', 0.088), ('interconnect', 0.08), ('establishing', 0.08), ('insider', 0.076), ('unusual', 0.072), ('solar', 0.072), ('cluster', 0.071), ('segment', 0.069), ('involving', 0.067), ('sorry', 0.066), ('hundreds', 0.064), ('divided', 0.064), ('infiniband', 0.064), ('enormous', 0.063), ('bridge', 0.063), ('facts', 0.063), ('divide', 0.061), ('universe', 0.061), ('apparently', 0.059), ('conventional', 0.059), ('evolved', 0.055), ('lives', 0.055), ('nodes', 0.055), ('insights', 0.054), ('interact', 0.053), ('dev', 0.053), ('players', 0.053), ('busy', 0.051), ('heavily', 0.05), ('transition', 0.05), ('persistence', 0.05), ('facing', 0.049), ('massively', 0.048), ('compare', 0.048), ('associated', 0.047), ('intensive', 0.047)]
simIndex simValue blogId blogTitle
same-blog 1 1.0 424 high scalability-2008-10-22-EVE Online Architecture
Introduction: Sorry, the content for this post apparently did not make the transition from the old HighScalability website, it's all messed up, but there's still a some useful content... EVE Online is "The World's Largest Game Universe", a massively multiplayer online game ( MMO ) made by CCP. EVE Online's Architecture is unusual for a MMOG because it doesn't divide the player load among different servers or shards. Instead, the same cluster handles the entire EVE universe. It is an interesting to compare this with the Architecture of the Second Life Grid . How do they manage to scale? Information Sources EVE Insider Dev Blog EVE Online FAQ Massively - Eve Evolved: Eve Online's Server Model and its discussion on Slashdot EVE Online Forums Massively Multiplayer Game Development 2 Platform Stackless Python used for both server and client game logic. It allows programmers to reap the benefits of thread-based programming without the performance and complexity p
2 0.41890812 1405 high scalability-2013-02-13-7 Sensible and 1 Really Surprising Way EVE Online Scales to Play Huge Games
Introduction: "Everything in war is simple, but the simplest thing is difficult." -- Carl von Clausewitz Games are proving grounds for software architecture. They combine scale, high performance, challenging problems, a rabid user base, cost sensitivity, and the need for profit. And when games have in-game currency, like EVE Online has, there's money at play, so you can't just get away with a c'est la vie attitude. Engineering must be applied. In Planning for war: how the EVE Online servers deal with a 3,000 person battle , we learn some techniques EVE Online uses to handle large games: 7 Sensible... Do nothing. Most games are manageable or have spikes that quickly dissipate. Run it Hot . There's nothing to throttle as servers run at 100%. Why waste money? Use all your CPU. Shard it . Games are sharded by solar system and multiple solar systems run on a node. Move it . Games are moved when a machine becomes overloaded. Live Node Remap, where a live game is moved to
3 0.24180888 1168 high scalability-2012-01-04-How Facebook Handled the New Year's Eve Onslaught
Introduction: How does Facebook handle the massive New Year's Eve traffic spike? Thanks to Mike Swift, in Facebook gets ready for New Year's Eve , we get a little insight as to their method for the madness, nothing really detailed, but still interesting. Problem Setup Facebook expects tha one billion+ photos will be shared on New Year's eve. Facebook's 800 million users are scattered around the world. Three quarters live outside the US. Each user is linked to an average of 130 friends. Photos and posts must appear in less than a second. Opening a homepage requires executing requests on a 100 different servers, and those requests have to be ranked, sorted, and privacy-checked, and then rendered. Different events put different stresses on different parts of Facebook. Photo and Video Uploads - Holidays require hundreds of terabytes of capacity News Feed - News events like big sports events and the death of Steve Jobs drive user status updates Coping Strategies Try
4 0.18599422 760 high scalability-2010-01-13-10 Hot Scalability Links for January 13, 2010
Introduction: Has Amazon EC2 become over subscribed? by Alan Williamson. Systemic problems hit AWS as users experience problems across Amazon's infrastructure. It seems the strange attractor of a cloud may be the same as for a shared hosting service. Understanding Infrastructure 2.0 by James Urquhart. We need to take a systems view of our entire infrastructure, and build our automation around the end-to-end architecture of that system . Hey You, Get Off of My Cloud: Exploring Information Leakage in Third-Party Compute Clouds . We show that it is possible to map the internal cloud infrastructure . Hadoop World: Building Data Intensive Apps with Hadoop and EC2 by Pete Skomoroch. Dives into detail about how he built TrendingTopics.org using Hadoop and EC2 . A Crash Course in Modern Hardware by Cliff Click. Yes, your mind will hurt after watching this. And no, you probably don't know what your microprocessor is doing anymore. EVE Scalability Explained by James Harrison. This pos
5 0.13944075 904 high scalability-2010-09-21-Playfish's Social Gaming Architecture - 50 Million Monthly Users and Growing
Introduction: Ten million players a day and over fifty million players a month interact socially with friends using Playfish games on social platforms like The Facebook, MySpace, and the iPhone. Playfish was an early innovator in the fastest growing segment of the game industry: social gaming , which is the love child between casual gaming and social networking. Playfish was also an early adopter of the Amazon cloud, running their system entirely on 100s of cloud servers. Playfish finds itself at the nexus of some hot trends (which may by why EA bought them for $300 million and they think a $1 billion game is possible): building games on social networks, build applications in the cloud, mobile gaming, leveraging data driven design to continuously evolve and improve systems, agile development and deployment, and selling virtual good as a business model. How can a small company make all this happen? To explain the magic I interviewed Playfish's Jodi Moran, Senior Director of Engineering, an
6 0.13807538 496 high scalability-2009-01-17-Scaling in Games & Virtual Worlds
7 0.12455537 422 high scalability-2008-10-17-Scaling Spam Eradication Using Purposeful Games: Die Spammer Die!
9 0.11356854 1588 high scalability-2014-01-31-Stuff The Internet Says On Scalability For January 31st, 2014
10 0.10464081 177 high scalability-2007-12-08-thesimsonstage.ea.com
11 0.10052183 1044 high scalability-2011-05-19-Zynga's Z Cloud - Scale Fast or Fail Fast by Merging Private and Public Clouds
12 0.099262223 1342 high scalability-2012-10-17-World of Warcraft's Lead designer Rob Pardo on the Role of the Cloud in Games
13 0.091082796 792 high scalability-2010-03-10-How FarmVille Scales - The Follow-up
14 0.089256451 962 high scalability-2010-12-21-Sponsored Post: Electronic Arts, Joyent, Membase, CloudSigma, ManageEngine, Site24x7
15 0.088348575 560 high scalability-2009-04-08-Learned lessons from the largest player (Flickr, YouTube, Google, etc)
16 0.08785782 1397 high scalability-2013-02-01-Stuff The Internet Says On Scalability For February 1, 2013
17 0.087729782 969 high scalability-2011-01-04-Sponsored Post: Newrelic, Cloudkick, Strata, EA, Joyent, CloudSigma, ManageEngine, Site24x7
20 0.072380185 1381 high scalability-2013-01-04-Stuff The Internet Says On Scalability For January 4, 2013
topicId topicWeight
[(0, 0.107), (1, 0.031), (2, 0.055), (3, -0.023), (4, 0.019), (5, -0.024), (6, 0.032), (7, 0.027), (8, -0.024), (9, -0.019), (10, 0.088), (11, -0.013), (12, 0.019), (13, 0.044), (14, 0.008), (15, 0.041), (16, 0.045), (17, 0.027), (18, -0.004), (19, 0.004), (20, 0.057), (21, -0.007), (22, -0.045), (23, -0.005), (24, -0.02), (25, 0.048), (26, 0.016), (27, -0.022), (28, -0.033), (29, -0.033), (30, 0.093), (31, 0.046), (32, -0.074), (33, -0.069), (34, 0.042), (35, 0.014), (36, 0.103), (37, -0.12), (38, 0.07), (39, -0.095), (40, 0.061), (41, -0.065), (42, 0.007), (43, 0.098), (44, 0.019), (45, 0.063), (46, 0.044), (47, -0.064), (48, 0.025), (49, 0.006)]
simIndex simValue blogId blogTitle
same-blog 1 0.95299953 424 high scalability-2008-10-22-EVE Online Architecture
Introduction: Sorry, the content for this post apparently did not make the transition from the old HighScalability website, it's all messed up, but there's still a some useful content... EVE Online is "The World's Largest Game Universe", a massively multiplayer online game ( MMO ) made by CCP. EVE Online's Architecture is unusual for a MMOG because it doesn't divide the player load among different servers or shards. Instead, the same cluster handles the entire EVE universe. It is an interesting to compare this with the Architecture of the Second Life Grid . How do they manage to scale? Information Sources EVE Insider Dev Blog EVE Online FAQ Massively - Eve Evolved: Eve Online's Server Model and its discussion on Slashdot EVE Online Forums Massively Multiplayer Game Development 2 Platform Stackless Python used for both server and client game logic. It allows programmers to reap the benefits of thread-based programming without the performance and complexity p
2 0.91533709 1405 high scalability-2013-02-13-7 Sensible and 1 Really Surprising Way EVE Online Scales to Play Huge Games
Introduction: "Everything in war is simple, but the simplest thing is difficult." -- Carl von Clausewitz Games are proving grounds for software architecture. They combine scale, high performance, challenging problems, a rabid user base, cost sensitivity, and the need for profit. And when games have in-game currency, like EVE Online has, there's money at play, so you can't just get away with a c'est la vie attitude. Engineering must be applied. In Planning for war: how the EVE Online servers deal with a 3,000 person battle , we learn some techniques EVE Online uses to handle large games: 7 Sensible... Do nothing. Most games are manageable or have spikes that quickly dissipate. Run it Hot . There's nothing to throttle as servers run at 100%. Why waste money? Use all your CPU. Shard it . Games are sharded by solar system and multiple solar systems run on a node. Move it . Games are moved when a machine becomes overloaded. Live Node Remap, where a live game is moved to
3 0.84434181 496 high scalability-2009-01-17-Scaling in Games & Virtual Worlds
Introduction: "Online games and virtual worlds have familiar scaling requirements, but don’t be fooled: everything you know is wrong." Jim Waldo, Sun Microsystems Laboratories * The computational environment for online games or virtual worlds is close to the exact inverse of that found in most markets serviced by the high-tech industry. * The need for a heavyweight client is, in part, an outcome of the evolution of these games. * Latency is the enemy of fun—and therefore the enemy of online games and virtual worlds. * The game server is used both to discourage cheating (by making it much more difficult) and to detect cheating (by seeing patterns of divergence between the game state reported by the client and the game state held by the server). Peer-to-peer technologies might seem a natural fit for the first role of the game server, but this second role means that few if any games or worlds trust their peers enough to avoid the server component. * Using multiple servers is a basic mecha
4 0.75474668 422 high scalability-2008-10-17-Scaling Spam Eradication Using Purposeful Games: Die Spammer Die!
Introduction: Update: As expected I'm undergoing a massive spam attack for speaking truth to dark powers. This is the time to be strong. Together we can make a change. What change you may ask? I can't say, just change and lots more change. Let's link arms together and bravely stand against the forces of chaos for a better yesterday and a better tomorrow. CAPTCHA doesn't work. Even Google can't make CAPTCHA work ( Spammers Choose GMail ). And even if CAPTCHA worked it wouldn't really work because CAPTCHA solving markets ( Inside India’s CAPTCHA solving economy ) have evolved where for a mere $2 you can buy 1000 human broken CAPTCHA's. And we know once the free market tackles a problem that's it. Game over :-) Making ever more clever CAPTCHA programs won't outwit and outlast the CAPTCHA solving markets. Until Skynet evolves the only way to defeat humans is with humans. Using Games to Get Humans to Do Work (like CAPTCHA) for Free How do we harness the power of humans to do battle with the C
Introduction: In a really far ranging and insightful interview by Steve Peterson: Game Industry Legends: Rob Pardo , where the future of gaming is discussed, there was a section on how the cloud might be used in games. I know there are a lot of game developers in my audience, so I thought it might be useful: Q. If the game is free-to-play but I have to download 10 gigabytes to try it out, that can keep me from trying it. That's part of what cloud gaming is trying to overcome; do you think cloud gaming is going to make some inroads because of those technical issues? Rob Pardo : I certainly think there's a lot of potential in cloud gaming, it's just picking the right games. There's a lot of hurdles for cloud gaming to overcome, one of which is having to have all these servers to be able to host all these games, since it's not like you need any less computing power to play these games. First of all you need someone with the infrastructure that can have all those games up there. Another issue t
6 0.67349154 904 high scalability-2010-09-21-Playfish's Social Gaming Architecture - 50 Million Monthly Users and Growing
7 0.64015561 1044 high scalability-2011-05-19-Zynga's Z Cloud - Scale Fast or Fail Fast by Merging Private and Public Clouds
8 0.57788765 755 high scalability-2009-12-28-Zynga Needs a Server-side Systems Engineer
9 0.5648039 792 high scalability-2010-03-10-How FarmVille Scales - The Follow-up
10 0.54518479 774 high scalability-2010-02-08-How FarmVille Scales to Harvest 75 Million Players a Month
11 0.4998706 1168 high scalability-2012-01-04-How Facebook Handled the New Year's Eve Onslaught
12 0.49792883 1412 high scalability-2013-02-25-SongPop Scales to 1 Million Active Users on GAE, Showing PaaS is not Passé
13 0.47506386 1075 high scalability-2011-07-07-Myth: Google Uses Server Farms So You Should Too - Resurrection of the Big-Ass Machines
14 0.46756425 473 high scalability-2008-12-20-Second Life Architecture - The Grid
15 0.4363651 1397 high scalability-2013-02-01-Stuff The Internet Says On Scalability For February 1, 2013
16 0.43011245 1524 high scalability-2013-09-30-Expandability: Steve Wozniak's Biggest Success and Nolan Bushnell's Biggest Regret
17 0.429369 1340 high scalability-2012-10-15-Simpler, Cheaper, Faster: Playtomic's Move from .NET to Node and Heroku
18 0.42036569 254 high scalability-2008-02-19-Hadoop Getting Closer to 1.0 Release
19 0.4039759 1610 high scalability-2014-03-11-Douglas Adams - 3 Rules that Describe Our Reactions to Technologies
20 0.40095046 1608 high scalability-2014-03-10-Let's Play a Game of Take It or Leave It - Game 1
topicId topicWeight
[(1, 0.616), (2, 0.124), (30, 0.01), (61, 0.052), (85, 0.058), (94, 0.028)]
simIndex simValue blogId blogTitle
Introduction: Who's Hiring? Apple is hiring for multiple positions. Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Quality Assurance Engineer. The iOS Systems team is looking for a Quality Assurance engineer. In this role you will be expected to work hand-in-hand with the software engineering team to find and diagnose software defects. Please apply here . Sr Software Engineer iPhone. Do you love building highly scalable, distributed web applications? Does the idea of a fast-paced environment make your heart leap? Do you want your technical abilities to be challenged every day, and for your work to make a difference in the lives of millions of people? Please apply here . Sr Software Engineer . The iOS Systems Team is looking for a Software Engineer to work on operations, tools development and support of worldwide iOS Device sales and activations. Please apply here . Sr. Se
Introduction: Who's Hiring? Apple is hiring for multiple positions. Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Sr Software Engineer . The Emerging Technology team is looking for a highly motivated, detail-oriented, energetic individual with experience in a variety of big data technologies. You will be part of a fast growing, cohesive team with many exciting responsibilities related to Big Data. Please apply here . C++ Senior Developer and Architect- Maps . The Maps Team is looking for a senior developer and architect to support and grow some of the core backend services that support Apple Map's Front End Services. Please apply here . Senior Engineer . We are looking for a team player with focus on designing and developing WWDR’s web-based applications. The successful candidate must have the ability to take minimal business requirements and work pro-actively with cross functional
Introduction: Who's Hiring? Want to build scalable systems that power the world's largest music streaming service? Spotify is looking for engineers for our backend infrastructure team. Apply now . At Evernote our vision is to help the world remember everything. If you want to work in a face paced, highly rewarding environment with some of the smartest engineers on the planet, then come join us ! We are looking for Sr. Security Engineers and Sr. Operations Engineers/DevOps to join our operations team. LogicMonitor is looking for a Front End developer to have a huge impact, be valued, realize their dreams, and help us realize ours. We are looking for someone to own the code that delivers the design and usability of LogicMonitor's enterprise SaaS application(s). Please apply online . We need awesome people @ Booking.com - We want YOU! Come design next generation interfaces, solve critical scalability problems, and hack on one of the largest Perl codebases. Please apply online
Introduction: Who's Hiring? Blurocket is looking for smart and fun people to build its next generation ecommerce platform. If creating scalable services is in your DNA, let us know! (Salary $250k+). Apply over at StackOverflow . Amazing things are happening at Dow Jones – help build the next generation News and Media platforms that serve the best journalism in the world. High-impact, passionate, and driven technologists thrive in our environment, building platforms that deliver trusted content that enlightens and inspires millions around the world. Please apply online LogicMonitor is looking for a Front End developer to have a huge impact, be valued, realize their dreams, and help us realize ours. We are looking for someone to own the code that delivers the design and usability of LogicMonitor's enterprise SaaS application(s). Please apply online . We need awesome people @ Booking.com - We want YOU! Come design next generation interfaces, solve critical scalability problems,
Introduction: Who's Hiring? Fitbit is hiring a Site Operations Lead to help us on our mission to make the world a healthier place! Fitbit's wearable fitness devices are worn by people across the world, each syncing with the web site, wirelessly and automatically, every 15 minutes. Join our mission here ! OLO 's food ordering platform powers some of the largest restaurant chains and feeds millions of consumers. We're looking for Senior C# Software Engineers and DevOps Engineers to help us scale our system. Apply here . The AWS Relational Database Service (RDS) automates management of relational databases in the cloud. We have a wide variety of customers and are part of many mission-critical applications, like the ones built by the 2012 Obama re-election campaign . If you're interested in joining a fast-growing service and team, please send your resume to rds-jobs@amazon.com . New Relic is looking for a Java Scalability Engineer in Portland, OR. Ready to scale a web s
18 0.99124211 204 high scalability-2008-01-08-Virus Scanning for Uploaded content