high_scalability high_scalability-2010 high_scalability-2010-873 knowledge-graph by maker-knowledge-mining
Source: html
Introduction: Twitter Sees Its 20 Billionth Tweet writes Marshall Kirkpatrick of ReadWriteWeb. Startups die for not having customers, so STOP thinking about how to scale . Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb...concentrate on marketing...concentrate on user experience . Alessandro is perfectly correct, but this isn't the year the 2000 when the default architecture that is easy is also not scalable and when sites were built from scratch one painful user at a time. Today neither is tue. In the era of social networks, where Facebook has 500 million users, successful applications can and often do spike to millions of users seemingly overnight. And you have to have some architecture. With today's tool-chains you don't have to choose easy and non-scalable. There are other options. Of course, it's all pointless without customers and that is what you need to worry about, but it's a false choice in this era to
sentIndex sentText sentNum sentScore
1 Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb. [sent-3, score-0.154]
2 Alessandro is perfectly correct, but this isn't the year the 2000 when the default architecture that is easy is also not scalable and when sites were built from scratch one painful user at a time. [sent-10, score-0.077]
3 In the era of social networks, where Facebook has 500 million users, successful applications can and often do spike to millions of users seemingly overnight. [sent-12, score-0.384]
4 Of course, it's all pointless without customers and that is what you need to worry about, but it's a false choice in this era to think that's all you have to worry about. [sent-16, score-0.436]
5 Ryan Dahl talks about how to handle thousands of connections with server side JavaScript. [sent-19, score-0.089]
6 It seems a little strange to still be talking about this same kind of stuff--event loops, async vs sync, thread pools, processes vs threads, etc--after 20 years, but Ryan does a really good job framing the issues. [sent-20, score-0.353]
7 In the end applications are about state machines, so those nasty abstractions arise somewhere. [sent-21, score-0.086]
8 Awesome coverage of Vertical Scaling; Horizontal Partitioning; Horizontal Scaling; Read Slaves; Multi-Master; Vertical Partitioning; Federated Data Storage; Database Life-cycle; OLAP vs OLTP; application type; Cloud; tools. [sent-29, score-0.127]
9 Alex Popescu collects a list of NoSQL data modeling sources. [sent-31, score-0.08]
10 Most interesting discussion from Dare Obasanjo on how in a social network world using invite scarcity to grow a user base fails because users can't port their network over. [sent-33, score-0.182]
wordName wordTfidf (topN-words)
[('demoted', 0.346), ('alessandro', 0.254), ('ryan', 0.148), ('vs', 0.127), ('vertical', 0.124), ('era', 0.121), ('pathologies', 0.115), ('dahl', 0.115), ('faculty', 0.115), ('kirkpatrick', 0.115), ('pointless', 0.115), ('locks', 0.112), ('strangers', 0.108), ('obasanjo', 0.108), ('databy', 0.108), ('marshall', 0.108), ('horizontal', 0.107), ('social', 0.104), ('retrospective', 0.103), ('scarcity', 0.103), ('influential', 0.103), ('welsh', 0.103), ('status', 0.103), ('worry', 0.1), ('bartosz', 0.099), ('billionth', 0.099), ('framing', 0.099), ('defeating', 0.096), ('anatomy', 0.094), ('partitioning', 0.092), ('callbacks', 0.091), ('talks', 0.089), ('threads', 0.089), ('dare', 0.088), ('popescu', 0.088), ('nasty', 0.086), ('american', 0.082), ('invite', 0.081), ('spaces', 0.081), ('seemingly', 0.081), ('august', 0.08), ('collects', 0.08), ('security', 0.079), ('federated', 0.079), ('users', 0.078), ('painful', 0.077), ('possibilities', 0.076), ('adam', 0.076), ('surface', 0.076), ('matt', 0.075)]
simIndex simValue blogId blogTitle
same-blog 1 0.99999958 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
Introduction: Twitter Sees Its 20 Billionth Tweet writes Marshall Kirkpatrick of ReadWriteWeb. Startups die for not having customers, so STOP thinking about how to scale . Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb...concentrate on marketing...concentrate on user experience . Alessandro is perfectly correct, but this isn't the year the 2000 when the default architecture that is easy is also not scalable and when sites were built from scratch one painful user at a time. Today neither is tue. In the era of social networks, where Facebook has 500 million users, successful applications can and often do spike to millions of users seemingly overnight. And you have to have some architecture. With today's tool-chains you don't have to choose easy and non-scalable. There are other options. Of course, it's all pointless without customers and that is what you need to worry about, but it's a false choice in this era to
2 0.11668362 392 high scalability-2008-09-24-Building a Scalable Architecture for Web Apps
Introduction: By Bhavin Turakhia CEO, Directi. Covers: * Why scalability is important. Viral marketing can result in instant success. With RSS/Ajax/SOA number of requests grow exponentially with user base. Goal is to build a web 2.0 app that can server millions of users with zero downtime. * Introduction to the variables. Scalability, performance, responsiveness, availability, downtime impact, cost, maintenance effort. * Introduction to the factors. Platform selection, hardware, application design, database architecture, deployment architecture, storage architecture, abuse prevention, monitoring mechanisms, etc. * Building our own scalable architecture in incremental steps: vertical scaling, vertical partitioning, horizontal scaling, horizontal partitioning, etc. First buy bigger. Then deploy each service on a separate node. Then increase the number of nudes and load balance. Deal with session management. Remove single points of failure. Use a shared nothing cluster. Choice of master-slave m
3 0.11422902 511 high scalability-2009-02-12-MySpace Architecture
Introduction: Update: Presentation: Behind the Scenes at MySpace.com . Dan Farino, Chief Systems Architect at MySpace shares details of some of MySpace's cool internal operations tools. MySpace.com is one of the fastest growing site on the Internet with 65 million subscribers and 260,000 new users registering each day. Often criticized for poor performance, MySpace has had to tackle scalability issues few other sites have faced. How did they do it? Site: http://myspace.com Information Sources Presentation: Behind the Scenes at MySpace.com Inside MySpace.com Platform ASP.NET 2.0 Windows IIS SQL Server What's Inside? 300 million users. Pushes 100 gigabits/second to the internet. 10Gb/sec is HTML content. 4,500+ web servers windows 2003/IIS 6.0/APS.NET. 1,200+ cache servers running 64-bit Windows 2003. 16GB of objects cached in RAM. 500+ database servers running 64-bit Windows and SQL Server 2005. MySpace processes 1.5 Billion page views per day and
Introduction: Where do you draw the line between scalability vs Performance vs High Availability vs Reliability? I guess at the end of the day, we all want to be highly available, great performance and always reliable. So is it safe to say that scalability is the answer ? Also when do you start to think scale out vs scale up ?
5 0.10624174 954 high scalability-2010-12-06-What the heck are you actually using NoSQL for?
Introduction: It's a truism that we should choose the right tool for the job . Everyone says that. And who can disagree? The problem is this is not helpful advice without being able to answer more specific questions like: What jobs are the tools good at? Will they work on jobs like mine? Is it worth the risk to try something new when all my people know something else and we have a deadline to meet? How can I make all the tools work together? In the NoSQL space this kind of real-world data is still a bit vague. When asked, vendors tend to give very general answers like NoSQL is good for BigData or key-value access. What does that mean for for the developer in the trenches faced with the task of solving a specific problem and there are a dozen confusing choices and no obvious winner? Not a lot. It's often hard to take that next step and imagine how their specific problems could be solved in a way that's worth taking the trouble and risk. Let's change that. What problems are you using NoSQL to sol
6 0.10433821 1425 high scalability-2013-03-18-Beyond Threads and Callbacks - Application Architecture Pros and Cons
7 0.10363375 1240 high scalability-2012-05-07-Startups are Creating a New System of the World for IT
8 0.10117002 695 high scalability-2009-09-06-Some Hot Links
10 0.10060159 750 high scalability-2009-12-16-Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud
11 0.097330704 538 high scalability-2009-03-16-Are Cloud Based Memory Architectures the Next Big Thing?
12 0.097180687 785 high scalability-2010-02-26-MySQL and Memcached: End of an Era?
13 0.097163685 721 high scalability-2009-10-13-Why are Facebook, Digg, and Twitter so hard to scale?
14 0.094913229 1509 high scalability-2013-08-30-Stuff The Internet Says On Scalability For August 30, 2013
15 0.091372617 973 high scalability-2011-01-14-Stuff The Internet Says On Scalability For January 14, 2011
16 0.090226762 976 high scalability-2011-01-20-75% Chance of Scale - Leveraging the New Scaleogenic Environment for Growth
17 0.089616239 906 high scalability-2010-09-22-Applying Scalability Patterns to Infrastructure Architecture
18 0.088225394 317 high scalability-2008-05-10-Hitting 300 SimbleDB Requests Per Second on a Small EC2 Instance
19 0.088142537 840 high scalability-2010-06-10-The Four Meta Secrets of Scaling at Facebook
20 0.087936111 804 high scalability-2010-04-06-Sponsored Post: Event - Social Developer Summit
topicId topicWeight
[(0, 0.187), (1, 0.081), (2, 0.036), (3, 0.028), (4, 0.027), (5, 0.01), (6, -0.061), (7, 0.022), (8, -0.002), (9, 0.042), (10, 0.031), (11, 0.047), (12, 0.027), (13, 0.038), (14, -0.07), (15, 0.004), (16, 0.041), (17, 0.008), (18, 0.035), (19, 0.036), (20, 0.016), (21, 0.025), (22, -0.007), (23, -0.03), (24, 0.039), (25, -0.024), (26, 0.018), (27, -0.019), (28, 0.02), (29, 0.027), (30, 0.058), (31, -0.059), (32, 0.003), (33, -0.004), (34, -0.002), (35, -0.033), (36, -0.013), (37, -0.013), (38, 0.015), (39, 0.021), (40, 0.041), (41, -0.017), (42, -0.035), (43, -0.015), (44, -0.069), (45, 0.023), (46, -0.01), (47, -0.006), (48, -0.004), (49, 0.008)]
simIndex simValue blogId blogTitle
same-blog 1 0.97248578 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
Introduction: Twitter Sees Its 20 Billionth Tweet writes Marshall Kirkpatrick of ReadWriteWeb. Startups die for not having customers, so STOP thinking about how to scale . Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb...concentrate on marketing...concentrate on user experience . Alessandro is perfectly correct, but this isn't the year the 2000 when the default architecture that is easy is also not scalable and when sites were built from scratch one painful user at a time. Today neither is tue. In the era of social networks, where Facebook has 500 million users, successful applications can and often do spike to millions of users seemingly overnight. And you have to have some architecture. With today's tool-chains you don't have to choose easy and non-scalable. There are other options. Of course, it's all pointless without customers and that is what you need to worry about, but it's a false choice in this era to
2 0.78211313 783 high scalability-2010-02-24-Hot Scalability Links for February 24, 2010
Introduction: Cassandra @ Twitter: An Interview with Ryan King . Great interview by Alex Popescu on Twitter's thought process for switching to Cassandra. Twitter chose Cassandra because it had more big system features out of the box. Is that Cassandra FTW? I Had Downtime Today. Here’s What I’m Doing About It by Patrick McKenzie. Awesome deep dive into went wrong with Bingo Card Creator. Sh*t happens. How do you design a process to help prevent it from happening and how do you deal with problems with integrity when they do? High Availability Principle : Request Queueing by Ashish Soni. Queue request to ride out traffic spikes: 1) Request Queuing allows your system to operate at optimal throughput. 2) Your users only experience linear degradation versus exponential degradation. 3) Your system experiences NO degradation. pfffft twatter tweeter by Knowbuddy. The reason you should care [about NoSQL] is because now you have more options--you're not stuck trying to wedge your system into
3 0.76459312 1024 high scalability-2011-04-15-Stuff The Internet Says On Scalability For April 15, 2011
Introduction: Submitted for your reading pleasure... Luxury is an ancient notion. There was once a Chinese mandarin who had himself wakened three times every morning simply for the pleasure of being told it was not yet time to get up . ~Argosy We have a Qutoable Quote machine for you today: @kevinweil : Twitter monthly signups have increased more than 50% since December, and we're now doing well over 150 million Tweets per day. @ChrisShain : Prediction: Black art of query optimization will become black art of #nosql data modeling, for same reasons. Minimize IOs, query time. @ui_matters : Infrastructure as a Service = no hardware headaches. Platform as a Svc = no scalability headaches. SaaS = common dev platform #amchamtech @plcstpierre : Thinking about high scalability stuff... I never thought database stuff can be interesting... @webdz9r : mass scalability for dynamic web content. What took us 8 machines, now take us 1 web and 1 app. @joelvarty : CDN is always an aft
4 0.7595554 811 high scalability-2010-04-16-Hot Scalability Links for April 16, 2010
Introduction: Twitter gets a total of 3 billion requests a day via its API ; 105,779,710 registered users; 300,000 new registered users a day; 180 million unique visitors a month; 55 million tweets a day. Who has the most servers? Google 1 million+; Intel 100K; 1&1 Internet 70K; Facebook 30K; Akamai 61K; Rackspace 56k+. Cloud Computing Economies of Scale . James Hamilton gives a fabulous talk breaking down where the costs are in the cloud. It's not where you may think. Higher utilization is the key. More here . Erlang Factory: Andy Gross: Distributed Erlang Systems In Operation: Patterns and Pitfalls by Martin J. Logan. Great overview of architecting distributed systems in Erlang. Covers what you want and don't want in a distributed system and how to compromise those elements, what's common, system design, cluster membership, load balancing, upgrades, debugging, and more. Extreme Scale Computing by Irving Wladawsky-Berger . “An exascale supercomputer capable of a million tr
5 0.74835372 869 high scalability-2010-07-30-Hot Scalability Links for July 30, 2010
Introduction: Jeremy Zawodny, while performing data alchemy in the dungeons of Craigslist, stored 1,250,000,000 Key/Value Pairs in Redis on a 32GB Machine . Data sorting world record: 1 terabyte, 1 minute . The system has 52 computer nodes, each node is a commodity server with two quad-core processors, 24 gigabytes (GB) memory and sixteen 500 GB disks . It's not just hardware though, they also built a software that utilized all their CPU and RAM. Tweets of Gold: wm : I am really getting the sense that none of you yokels waxing profound about scalability actually has anything factual to say joestump : I think you can do things to *mitigate* pain points up front. You don't need to over-engineer, but it's not hard to look forward. danielcrenna : I love it when I check in debug code accidentally and it turns into a three day hunt for a major scalability problem joestump : Your post also makes me think of another phrase I say often: Scaling == Specialization. Bigger scale =
6 0.74372357 723 high scalability-2009-10-16-Paper: Scaling Online Social Networks without Pains
7 0.73375922 1424 high scalability-2013-03-15-Stuff The Internet Says On Scalability For March 15, 2013
8 0.73337603 976 high scalability-2011-01-20-75% Chance of Scale - Leveraging the New Scaleogenic Environment for Growth
9 0.7268033 1067 high scalability-2011-06-24-Stuff The Internet Says On Scalability For June 24, 2011
10 0.71145183 1344 high scalability-2012-10-19-Stuff The Internet Says On Scalability For October 19, 2012
11 0.71137208 1630 high scalability-2014-04-11-Stuff The Internet Says On Scalability For April 11th, 2014
12 0.71072495 1057 high scalability-2011-06-10-Stuff The Internet Says On Scalability For June 10, 2011
13 0.71027148 967 high scalability-2011-01-03-Stuff The Internet Says On Scalability For January 3, 2010
14 0.70925289 1476 high scalability-2013-06-14-Stuff The Internet Says On Scalability For June 14, 2013
15 0.70562458 1368 high scalability-2012-12-07-Stuff The Internet Says On Scalability For December 7, 2012
16 0.70217782 848 high scalability-2010-06-25-Hot Scalability Links for June 25, 2010
17 0.70168066 1019 high scalability-2011-04-08-Stuff The Internet Says On Scalability For April 8, 2011
18 0.69514626 860 high scalability-2010-07-17-Hot Scalability Links for July 17, 2010
19 0.69421351 999 high scalability-2011-03-04-Stuff The Internet Says On Scalability For March 4, 2011
20 0.69362336 1626 high scalability-2014-04-04-Stuff The Internet Says On Scalability For April 4th, 2014
topicId topicWeight
[(1, 0.114), (2, 0.211), (10, 0.029), (47, 0.032), (48, 0.213), (49, 0.01), (61, 0.051), (77, 0.046), (79, 0.105), (85, 0.085), (94, 0.023)]
simIndex simValue blogId blogTitle
same-blog 1 0.88117069 873 high scalability-2010-08-06-Hot Scalability Links for Aug 6, 2010
Introduction: Twitter Sees Its 20 Billionth Tweet writes Marshall Kirkpatrick of ReadWriteWeb. Startups die for not having customers, so STOP thinking about how to scale . Alessandro Orsi says focusing on the architecture and scaling possibilities of your app for millions of users is just plain dumb...concentrate on marketing...concentrate on user experience . Alessandro is perfectly correct, but this isn't the year the 2000 when the default architecture that is easy is also not scalable and when sites were built from scratch one painful user at a time. Today neither is tue. In the era of social networks, where Facebook has 500 million users, successful applications can and often do spike to millions of users seemingly overnight. And you have to have some architecture. With today's tool-chains you don't have to choose easy and non-scalable. There are other options. Of course, it's all pointless without customers and that is what you need to worry about, but it's a false choice in this era to
2 0.83953667 1495 high scalability-2013-07-22-We're on a Break
Introduction: Hey, just letting you know I'll be on vacation starting today and I'll be back in a few weeks. I won't be posting anything new, so we'll all have a refreshing break. Feel free to cheat with other blogs and social networks.
3 0.83633125 610 high scalability-2009-05-29-Is Eucalyptus ready to be your private cloud?
Introduction: Update: : Eucalyptus Goes Commercial with $5.5M Funding Round . This removes my objection that it's an academic project only. Go team go! Rich Wolski , professor of Computer Science at the University of California, Santa Barbara, gave a spirited talk on Eucalyptus to a large group of very interested cloudsters at the Eucalyptus Cloud Meetup . If Rich could teach computer science at every school the state of the computer science industry would be stratospheric. Rich is dynamic, smart, passionate, and visionary. It's that vision that prompted him to create Eucalyptus in the first place. Rich and his group are experts in grid and distributed computing, having a long and glorious history in that space. When he saw cloud computing on the rise he decided the best way to explore it was to implement what everyone accepted as a real cloud, Amazon's API. In a remarkably short time they implement Eucalyptus and have been improving it and tracking Amazon's changes ever since. The question
4 0.82225025 611 high scalability-2009-05-31-Need help on Site loading & database optimization - URGENT
Introduction: Hi Friends, I need some help in making site access fast. On an average my site has the traffic 2500 hits per day and on 16th May it had 60,000 hits. On this day site was loading very slow even it was getting time out. I also check out the processes running by using "top" command it was indicating mysql was taking too much load. There are around 166 tables (Including PHPBB forum) in my database. All contents on site are displayed by fetching it from database. I have also added indexing to respective tables where it is required. Plain PHP/HTML coding is used. Technology: PHP -- 5.2 MYSQL -- 5.0 Apache -- 2.0 Linux Following is all the server details of my site: CPU : Single Socket Dual Core AMD Opteron 1212HE Memory: 2GB DDR RAM Hard Drive: 250GB SATA Ethernet: 100Mb Primary Ethernet Card (/var/log) # uname -a Linux 2.6.9-67.0.15.ELsmp #1 SMP Tue Apr 22 13:50:33 EDT 2008 i686 athlon i386 GNU/Linux kernel version: 2.6.9-67.0.15.ELsmp (/var/log) # free -m total used
5 0.80958194 393 high scalability-2008-09-25-GridGain: One Compute Grid, Many Data Grids
Introduction: GridGain was kind enough to present at the September 17th instance of the Silicon Valley Cloud Computing Group . I've been curious about GridGain so I was glad to see them there. In short GridGain is: an open source computational grid framework that enables Java developers to improve general performance of processing intensive applications by splitting and parallelizing the workload . GridGain can also be thought of as a set of middleware primitives for building applications. GridGain's peer group of competitors includes GigaSpaces, Terracotta, Coherence, and Hadoop. The speaker for GridGain was the President and Founder, Nikita Ivanov. He has a very pleasant down-to-earth way about him that contrasts nicely with a field given to religious discussions of complex taxomic definitions. Nikita first talked about cloud computing in general. He feels Java is the perfect gateway for cloud computing. Which is good because GridGain only works with Java . The Java centricity of G
6 0.80300087 880 high scalability-2010-08-13-Hot Scalability Links for Aug 13, 2010
7 0.80264312 1612 high scalability-2014-03-14-Stuff The Internet Says On Scalability For March 14th, 2014
9 0.79678541 496 high scalability-2009-01-17-Scaling in Games & Virtual Worlds
10 0.78306431 1080 high scalability-2011-07-15-Stuff The Internet Says On Scalability For July 15, 2011
11 0.77987349 628 high scalability-2009-06-13-Neo4j - a Graph Database that Kicks Buttox
12 0.77945364 1361 high scalability-2012-11-22-Gone Fishin': PlentyOfFish Architecture
13 0.77932447 671 high scalability-2009-08-05-Stack Overflow Architecture
14 0.77836055 638 high scalability-2009-06-26-PlentyOfFish Architecture
15 0.77785569 1327 high scalability-2012-09-21-Stuff The Internet Says On Scalability For September 21, 2012
16 0.77754062 1177 high scalability-2012-01-19-Is it time to get rid of the Linux OS model in the cloud?
17 0.77706242 1348 high scalability-2012-10-26-Stuff The Internet Says On Scalability For October 26, 2012
18 0.7767331 1000 high scalability-2011-03-08-Medialets Architecture - Defeating the Daunting Mobile Device Data Deluge
19 0.77621096 1592 high scalability-2014-02-07-Stuff The Internet Says On Scalability For February 7th, 2014
20 0.77611148 1237 high scalability-2012-05-02-12 Ways to Increase Throughput by 32X and Reduce Latency by 20X